-- Logs begin at Thu 2022-05-26 11:42:28 UTC, end at Thu 2022-05-26 13:47:27 UTC. -- May 26 12:23:38.894354 dv-cinder-815146-11-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 12:23:38.904868 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 12:23:38 2022] *** May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: nodename: dv-cinder-815146-11-iscsi May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: machine: x86_64 May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: clock source: unix May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: pcre jit disabled May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: detected number of CPU cores: 4 May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: current working directory: / May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: detected binary path: /usr/bin/uwsgi-core May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: your processes number limit is 47680 May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: your memory page size is 4096 bytes May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: detected max file descriptor number: 2048 May 26 12:23:38.907376 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: lock engine: pthread robust mutexes May 26 12:23:38.908937 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: thunder lock: enabled May 26 12:23:38.908937 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 12:23:38.908937 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 12:23:38.957537 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: Python main interpreter initialized at 0x556622c1c9c0 May 26 12:23:38.957537 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: python threads support enabled May 26 12:23:38.957537 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: your server socket listen backlog is limited to 100 connections May 26 12:23:38.957537 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: your mercy for graceful operations on workers is 90 seconds May 26 12:23:38.958059 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: mapped 403077 bytes (393 KB) for 2 cores May 26 12:23:38.958059 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: *** Operational MODE: preforking *** May 26 12:23:38.958380 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: *** uWSGI is running in multiple interpreter mode *** May 26 12:23:38.958380 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: spawned uWSGI master process (pid: 80374) May 26 12:23:38.958628 dv-cinder-815146-11-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 12:23:38.964035 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: spawned uWSGI worker 1 (pid: 80388, cores: 1) May 26 12:23:38.964035 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: spawned uWSGI worker 2 (pid: 80389, cores: 1) May 26 12:23:38.964035 dv-cinder-815146-11-iscsi devstack@keystone.service[80374]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 12:23:44.897933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:44.897933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: from cryptography.utils import int_from_bytes May 26 12:23:44.898709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:44.898709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: from cryptography.utils import int_from_bytes May 26 12:23:44.919312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:44.919312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: from cryptography.utils import int_from_bytes May 26 12:23:44.919913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 12:23:44.919913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: from cryptography.utils import int_from_bytes May 26 12:23:44.949338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:23:44.949535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:23:44.949727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] command line args: [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:23:44.949995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:23:44.950171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ================================================================================ {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:23:44.950423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] admin_token = **** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.950696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] config_dir = [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.950884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.951065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] config_source = [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.951244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] debug = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.951461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.951945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.952030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.952235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.952483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.952873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] list_limit = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.953060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] log_config_append = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.953319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.953445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] log_dir = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.953565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] log_file = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.953802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.954048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.954296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.954570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.954753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.954925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.955174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.955417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.955649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.955886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.956115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.956345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.956591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.956836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.957111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.957904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.957904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] publish_errors = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.958087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.958222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.958397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.958671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.958907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.959142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] standard_threads = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.959371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.959615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.959790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.959967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] use_journal = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.960141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] use_json = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.960318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] use_stderr = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.960491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] use_syslog = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.960719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.960977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.961214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.961474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.961712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.961960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.962196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.962444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.962753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.962954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.963199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.963450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.963684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.963929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.964164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.964409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.964655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.964889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.965143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.965394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.965637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.965890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.966133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.966396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.966670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.966919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.967150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.967379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.967609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.967844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.968094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.969013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.969360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.969516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.969659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 12:23:44.969886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 12:23:44.969992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.970079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] command line args: [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 12:23:44.970159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.970322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 12:23:44.970406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.970502 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ================================================================================ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 12:23:44.970666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.970797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] admin_token = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.970898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.971039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_dir = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.971132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.971225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.971307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.971407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] config_source = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.971494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.971587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] debug = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.971714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.971789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.971945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.972034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.972175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.972251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.972412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.972494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.972664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.972764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.972888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.972965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.973069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_config_append = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.973153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.973235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.973342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.973425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_dir = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.973573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.973651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.973806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.973890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.974053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.974135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.974282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.974414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.974517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.974698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.974775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.974833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.974900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.974986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.975146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.975249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.975395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.975484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.975634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.975717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.975869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.975954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.976103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.976203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.976337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.976404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.976567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.976634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.976821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.976893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.977056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.977197 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.977285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.977509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.977578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.60/identity {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.977744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.977818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] publish_errors = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.978002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.978075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.978197 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.978318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.978416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.978476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.978631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.978712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.978869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.978958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.979105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] standard_threads = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.979177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.979341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.979521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.979623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.979724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.979820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.979946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.980064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_journal = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.980064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_json = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.980241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.980336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_stderr = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.980437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.980542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] use_syslog = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.980659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.980735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 12:23:44.980850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.980926 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.981934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.982051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.982173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.982301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.982411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.982551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.982676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.982820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.982907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.983076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.983162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.983330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.983419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.983566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.983649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.983863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.984552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.984645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.984746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.984959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.985079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.985269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.985362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.985544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.985660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.985846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.986563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.986638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.986699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.986757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.986835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.986899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.986899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.987005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.987063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.987252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.987416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.987521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.987619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.987754 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] auth.external = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.988969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.989071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] auth.password = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.989199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.989306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] auth.token = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.989433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.989554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.989709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.989791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.989959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.990038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.990199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.990297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.990452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.990561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.990721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.990801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.990967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] credential.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.991981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.992124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.992203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.992360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.992445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.992593 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.992678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.992829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.992914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.993069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.993137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.993301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.993377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.993546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.993652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.993779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.993862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.994026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.994118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.994256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.994336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.994494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.994596 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.994756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.994848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.995480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.995584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] federation.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.995660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.995730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.995792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.995859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.996927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.997991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.998074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.998231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.998313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.998479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.998609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.998739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.998821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.998980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.999061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.999229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.999336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.999489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.999578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.999759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:44.999858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.000061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.000145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.000305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.000427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.000530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.000643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.000758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.001960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.002977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003262 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.003973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.004062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.004213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.004294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.004462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.004544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.004695 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.004808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.004930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.005971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.006114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.006199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.006351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.006439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.006600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.006685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.external = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.006836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.006916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.007070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.007165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.007313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.007395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.007551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.007650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.password = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.007787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.007877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] auth.token = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.008972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.009981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.010128 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.010199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.010370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.010494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.011356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.011496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.011496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.012302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.012395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.012472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.012535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.012626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.012879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.012967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.013042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.013111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.013186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.013257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.013797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.013880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.013953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.013953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.014103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.014858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.014945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.015049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.015116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.015205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.015267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.015540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.015619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.015681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.015772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.016521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.016642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.016761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.016840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.016921 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.016995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017604 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.017973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.018968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019343 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] resource.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.019937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.020978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] role.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] role.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.021939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.022951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.023070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.023198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.023444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.023561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.023639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.023712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.023784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.023885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.024089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.024171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.024364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.024442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.024603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.024681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.024845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.025033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.025114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.025269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.025348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.025521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.025610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.025762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.025841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.026988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.027321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.027474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.027553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.027713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.027807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028105 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.028970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.029038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.029207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.029276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.029442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.029512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.029727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.029866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.029943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] token.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.030005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.030138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.030209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.030396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.030510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.031350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.031451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.031451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.031645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.031777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.031864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.031927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.031999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.032083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.032159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.032336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.032418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.032585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.032666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.032821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.032903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.033044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.033117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.033282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.033372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.033526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.033609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.033773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.033854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.034000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.034081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.034241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.034330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.034513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.034635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.034853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.034934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.connection = **** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.035094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.035189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.035344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.035426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.035595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.035683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.035836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.035926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.036073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.036220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.036355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.036502 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.036632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.036786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.036915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.037043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.037170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.037297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.037443 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.037583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.037710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.037791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.037923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.038938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.039011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.039105 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.039185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.039258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80389) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:23:45.039394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.039646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.039884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.040133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.040447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.040650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.040901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.041152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.041383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.041635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.041883 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.042136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.042385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.042663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.042915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.043163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.043412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.043646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.043894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.044143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.044393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.044643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.045070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.045303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.045556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.045806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.046055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.047001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.047237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.047502 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.047762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.048014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.048251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.048485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.048719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.048973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.049237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.049488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.049728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.049966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.050202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.050439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.050719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.050969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.051209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.051467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.051717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.051957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.052204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.052449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.052699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.052938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.053177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.053412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.053659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.053910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.054141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.054393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.054712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.054986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.055233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.055483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.055724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.055969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.056235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.056449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.056689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.056928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.057194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.057413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.057660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.057898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.058148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.058384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.058663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.058896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.059146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.059382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 12:23:45.059553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80388) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 12:23:45.071148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.071381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.071606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.080640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.085162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.085397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.085623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.096655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.110608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.110838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.116941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.117172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.165817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.165989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.219055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.219281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.221492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.221725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.297156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.297314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.297584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.297672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.297672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.297809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.297883 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.297966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.298097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.298213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.298297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.298387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.322056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.322286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.322511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.322625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.322757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.322863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.322973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.323058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.323186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.323270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.323398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.323492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.323611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.323825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.341978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.342125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.362341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.362497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.362595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.362675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.362836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.362950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.363030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.363105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.363239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.363323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.363456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.363562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.363687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80389) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.363804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80388) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 12:23:45.381324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.381496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.381613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:23:45.381696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:23:45.381860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.382004 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.382088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:23:45.382208 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 12:23:45.382301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.382482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.382596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.382809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.382896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.388234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.388345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.388345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.395469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.395825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.396157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.396503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.396820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.397108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.397374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.397653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.405749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.406545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.409231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.409507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.409789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.409895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.410069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.410154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.410350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.410434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.410632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.410741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.410902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.411026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.411345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.411532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.416958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.417066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.417149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.417227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.417303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.417391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.417391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.417391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.441499 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.441649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.443331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.443431 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.443610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.443696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.449089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.449203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.464634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.464753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.464836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.464913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.464913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.465042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.465107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.465286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.465286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.465942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.466001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.466059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.466126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.466186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.466257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.483140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.483387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.483473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.483668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.488673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.489212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.492356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.492649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.492988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.493281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.497854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.498482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.502150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.502933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.506010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.506302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.506622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.506766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.507787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.507877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.507957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.508033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.508118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.508195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.508195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.508195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.527588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.527875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.528141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.528307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.528406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.528606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.528871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.529200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.536888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.537467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.538626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.538921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.539219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.539494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.542012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.542290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.542596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.542698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.542880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.542979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.543157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.543325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.543478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.543763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.557498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.557777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.558063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.558347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.558513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.558743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.558844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.559036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.559135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.559323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.559421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.559631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.559905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.560188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.579008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.579593 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.582320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.582956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.585698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.586300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.587515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.587955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.589067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.589350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.589597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.589706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.589882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.590166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.597386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.597706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.599034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.599379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.602309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.602619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.602723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.602935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.603031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.603223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.603307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.603526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.613215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.613494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.613588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.613786 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.613870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.614174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.622027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80388) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.622204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80389) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 12:23:45.622300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.622485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.622610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.622792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.622878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.623076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.623160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.623349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.623450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.623621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.623705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.623906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.623998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.624184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.624348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.624543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.624685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.624823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.625062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.625202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.625338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.625473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.625609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.625747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80388) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.625948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.625948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80389) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 12:23:45.666775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556622c1c9c0 pid: 80388 (default app) May 26 12:23:45.667053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x556622c1c9c0 pid: 80389 (default app) May 26 12:23:45.670083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b755-1409-4dfe-ade4-aa640c6a8922 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:45.670388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b755-1409-4dfe-ade4-aa640c6a8922 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:45.670693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18b755-1409-4dfe-ade4-aa640c6a8922 None None] PATH_INFO: `/v3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:45.675144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 791 bytes} [Thu May 26 12:23:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:23:55.096872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0ebe-5322-42d9-a4ae-30e20200015a None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.097463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0ebe-5322-42d9-a4ae-30e20200015a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.097463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba0ebe-5322-42d9-a4ae-30e20200015a None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.101908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1/2] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:23:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:55.107133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa382be-e067-48b5-af56-71662fca814b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.107592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa382be-e067-48b5-af56-71662fca814b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.107697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa382be-e067-48b5-af56-71662fca814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.178136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: INFO dbcounter [None req-1fa382be-e067-48b5-af56-71662fca814b None None] Registered counter for database keystone May 26 12:23:55.200405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG oslo_db.sqlalchemy.engines [None req-1fa382be-e067-48b5-af56-71662fca814b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80388) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:55.207086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writer thread running {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:55.391545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG passlib.handlers.bcrypt [None req-1fa382be-e067-48b5-af56-71662fca814b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80388) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:23:55.391976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG passlib.handlers.bcrypt [None req-1fa382be-e067-48b5-af56-71662fca814b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80388) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:23:55.449420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1fa382be-e067-48b5-af56-71662fca814b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:55.451087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1fa382be-e067-48b5-af56-71662fca814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:55.583466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 2/3] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:23:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 12:23:55.735557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0ebe-5322-42d9-a4ae-30e20200015a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:55.806401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: INFO dbcounter [None req-e5ba0ebe-5322-42d9-a4ae-30e20200015a None None] Registered counter for database keystone May 26 12:23:55.826165 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG oslo_db.sqlalchemy.engines [None req-e5ba0ebe-5322-42d9-a4ae-30e20200015a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80389) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 12:23:55.833590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writer thread running {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 12:23:55.956469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba0ebe-5322-42d9-a4ae-30e20200015a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:55.960772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b63419-d175-4f0c-8c58-10a2c007f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:55.961431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b63419-d175-4f0c-8c58-10a2c007f7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:55.961712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b63419-d175-4f0c-8c58-10a2c007f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:55.961983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b63419-d175-4f0c-8c58-10a2c007f7f5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:55.971373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b63419-d175-4f0c-8c58-10a2c007f7f5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.023148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b3b63419-d175-4f0c-8c58-10a2c007f7f5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:23:56.023390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b63419-d175-4f0c-8c58-10a2c007f7f5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.034793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 2/4] 10.222.0.60 () {58 vars in 1324 bytes} [Thu May 26 12:23:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:23:56.040938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa382be-e067-48b5-af56-71662fca814b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:56.055548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa382be-e067-48b5-af56-71662fca814b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:56.060093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62a620-7168-4680-833b-8168c8001926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:56.061233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a620-7168-4680-833b-8168c8001926 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:56.061516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a620-7168-4680-833b-8168c8001926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:56.061791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62a620-7168-4680-833b-8168c8001926 admin admin] PATH_INFO: `/v3/projects/d4d4adba733e41f4aa7039514b116efa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:56.063594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62a620-7168-4680-833b-8168c8001926 admin admin] RBAC: Authorizing `identity:get_project(project_id=d4d4adba733e41f4aa7039514b116efa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:56.117834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ec62a620-7168-4680-833b-8168c8001926 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 12:23:56.118882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62a620-7168-4680-833b-8168c8001926 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:56.123013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 3/5] 10.222.0.60 () {56 vars in 1207 bytes} [Thu May 26 12:23:56 2022] GET /identity/v3/projects/d4d4adba733e41f4aa7039514b116efa => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:23:58.363001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5489-c4aa-45a6-9a75-7c46ace228a3 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.363556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5489-c4aa-45a6-9a75-7c46ace228a3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.363556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea5489-c4aa-45a6-9a75-7c46ace228a3 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.367698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 3/6] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:23:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:23:58.373266 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52a12-44ba-4a15-ba72-5b71c1c43333 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.373685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52a12-44ba-4a15-ba72-5b71c1c43333 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.373828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a52a12-44ba-4a15-ba72-5b71c1c43333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.393209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-40a52a12-44ba-4a15-ba72-5b71c1c43333 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:23:58.394776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-40a52a12-44ba-4a15-ba72-5b71c1c43333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:23:58.402772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 4/7] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:23:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 12:23:58.426154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5489-c4aa-45a6-9a75-7c46ace228a3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.438506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea5489-c4aa-45a6-9a75-7c46ace228a3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.442806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0084d9bc-c553-4d9c-b5aa-de712b559d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.443448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084d9bc-c553-4d9c-b5aa-de712b559d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.443730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084d9bc-c553-4d9c-b5aa-de712b559d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.444003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0084d9bc-c553-4d9c-b5aa-de712b559d75 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.452158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084d9bc-c553-4d9c-b5aa-de712b559d75 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:58.455366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0084d9bc-c553-4d9c-b5aa-de712b559d75 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:58.464498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 4/8] 10.222.0.60 () {58 vars in 1324 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:23:58.470370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a52a12-44ba-4a15-ba72-5b71c1c43333 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:23:58.479577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a52a12-44ba-4a15-ba72-5b71c1c43333 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:23:58.483993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c76dac3-252d-488b-89fc-06c75c6de218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:23:58.484874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76dac3-252d-488b-89fc-06c75c6de218 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:23:58.485159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76dac3-252d-488b-89fc-06c75c6de218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:23:58.485432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c76dac3-252d-488b-89fc-06c75c6de218 admin admin] PATH_INFO: `/v3/users/bc7504a99e7249a395b2c1252117a52e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:23:58.486856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76dac3-252d-488b-89fc-06c75c6de218 admin admin] RBAC: Authorizing `identity:get_user(user_id=bc7504a99e7249a395b2c1252117a52e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:23:58.488693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c76dac3-252d-488b-89fc-06c75c6de218 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:23:58.490298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 5/9] 10.222.0.60 () {56 vars in 1198 bytes} [Thu May 26 12:23:58 2022] GET /identity/v3/users/bc7504a99e7249a395b2c1252117a52e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:00.842275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552c17-aff6-4941-9129-2e83fffbfc1b None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.842869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552c17-aff6-4941-9129-2e83fffbfc1b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.842869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13552c17-aff6-4941-9129-2e83fffbfc1b None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.844263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 5/10] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:00.849984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfce07-a9c2-49b2-9de8-45f7cae8b01a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.850477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfce07-a9c2-49b2-9de8-45f7cae8b01a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.850716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfce07-a9c2-49b2-9de8-45f7cae8b01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.869497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-efbfce07-a9c2-49b2-9de8-45f7cae8b01a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:00.870774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-efbfce07-a9c2-49b2-9de8-45f7cae8b01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:00.879084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053de27-8a91-4c90-ae29-93c3a03a9014 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.879366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053de27-8a91-4c90-ae29-93c3a03a9014 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.879650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053de27-8a91-4c90-ae29-93c3a03a9014 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.881033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 6/11] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:00.886811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:00.887101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:00.887372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:00.929373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG passlib.handlers.bcrypt [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80389) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 12:24:00.929821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG passlib.handlers.bcrypt [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80389) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 12:24:00.969786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 6/12] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:00.977713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:00.979373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:00.992576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfce07-a9c2-49b2-9de8-45f7cae8b01a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.018089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.091085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 7/13] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:01.107128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfce07-a9c2-49b2-9de8-45f7cae8b01a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.114680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.144674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b971311-5234-4604-858b-dae77370fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.145332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b971311-5234-4604-858b-dae77370fdaf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.145620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b971311-5234-4604-858b-dae77370fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.145909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b971311-5234-4604-858b-dae77370fdaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.331896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00624965-fc37-4507-9f5e-ccefb0cd2f35 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.334204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.335757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b971311-5234-4604-858b-dae77370fdaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.337697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b971311-5234-4604-858b-dae77370fdaf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.362466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.370148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841856a2-b8fa-4a61-998f-b0f5eb21afc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.371226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841856a2-b8fa-4a61-998f-b0f5eb21afc9 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.371509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841856a2-b8fa-4a61-998f-b0f5eb21afc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.371781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841856a2-b8fa-4a61-998f-b0f5eb21afc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.385429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841856a2-b8fa-4a61-998f-b0f5eb21afc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-841856a2-b8fa-4a61-998f-b0f5eb21afc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:01.397040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:01.399197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:01.400005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 8/14] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:01.404436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841856a2-b8fa-4a61-998f-b0f5eb21afc9 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.440724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 7/15] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:01.446200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b971311-5234-4604-858b-dae77370fdaf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.509978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841856a2-b8fa-4a61-998f-b0f5eb21afc9 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.549261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b971311-5234-4604-858b-dae77370fdaf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.553904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.554613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.554899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.555174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.555934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:01.556239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.557693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.570255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 9/16] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.572672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.575812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.587236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.588484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.588972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.589486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.607325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.608138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.610243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:01.632578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:01.633482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:01.634277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:01.634277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:01.634277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:01.634277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:01.634277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 8/17] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:01.639981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.683461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99623e79-bedb-4fb1-9153-e7a461160274 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.721895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65701450-a8f6-4353-8ac0-03cb5b7061b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.722794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65701450-a8f6-4353-8ac0-03cb5b7061b7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.723076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65701450-a8f6-4353-8ac0-03cb5b7061b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.723350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65701450-a8f6-4353-8ac0-03cb5b7061b7 None admin] PATH_INFO: `/v3/users/bc7504a99e7249a395b2c1252117a52e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.725206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65701450-a8f6-4353-8ac0-03cb5b7061b7 None admin] RBAC: Authorizing `identity:get_user(user_id=bc7504a99e7249a395b2c1252117a52e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.726747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65701450-a8f6-4353-8ac0-03cb5b7061b7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.728403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 10/18] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/users/bc7504a99e7249a395b2c1252117a52e => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.733766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65701450-a8f6-4353-8ac0-03cb5b7061b7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.754932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46d8a53-0847-4244-9f99-f4f94def9030 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.793892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.794594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.794879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.795160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.795885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:01.796192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.797796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.817312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 9/19] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.835086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:01.842784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65701450-a8f6-4353-8ac0-03cb5b7061b7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:01.887568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3000eb3-cfce-423d-9b88-6fdde8cadac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:01.888310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3000eb3-cfce-423d-9b88-6fdde8cadac8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:01.888593 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3000eb3-cfce-423d-9b88-6fdde8cadac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:01.888857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3000eb3-cfce-423d-9b88-6fdde8cadac8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:01.890155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3000eb3-cfce-423d-9b88-6fdde8cadac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:01.891713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3000eb3-cfce-423d-9b88-6fdde8cadac8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:01.895964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 11/20] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:01.899596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:01.939858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:02.013501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243d55b-1b61-43a3-a482-b6434b6d0163 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:02.049821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed016781-a503-4f37-92d3-5272d77af8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:02.050485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016781-a503-4f37-92d3-5272d77af8ae None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:02.050799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016781-a503-4f37-92d3-5272d77af8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:02.051073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed016781-a503-4f37-92d3-5272d77af8ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:02.051921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed016781-a503-4f37-92d3-5272d77af8ae None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.domain.id=default, user.id=bc7504a99e7249a395b2c1252117a52e) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:02.052234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed016781-a503-4f37-92d3-5272d77af8ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:02.053696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed016781-a503-4f37-92d3-5272d77af8ae None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:02.061412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 10/21] 10.222.0.60 () {56 vars in 1322 bytes} [Thu May 26 12:24:01 2022] GET /identity/v3/role_assignments?user.id=bc7504a99e7249a395b2c1252117a52e&scope.domain.id=default&role.id=07de3e1931ca4d799df8510428e181aa => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:04.941232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29218082-4a25-403d-8166-188f697bbeb2 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.941232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29218082-4a25-403d-8166-188f697bbeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.941232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29218082-4a25-403d-8166-188f697bbeb2 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.942372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 12/22] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:04.946540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e80b54-cc70-49c8-9cf8-951fdd191b50 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:04.946954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e80b54-cc70-49c8-9cf8-951fdd191b50 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:04.947121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e80b54-cc70-49c8-9cf8-951fdd191b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:04.972781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-68e80b54-cc70-49c8-9cf8-951fdd191b50 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:04.974025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-68e80b54-cc70-49c8-9cf8-951fdd191b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:05.092027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 11/23] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:05.147489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29218082-4a25-403d-8166-188f697bbeb2 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:05.238936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17905-b3f0-42fe-9255-36ce98bdfea3 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.239209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17905-b3f0-42fe-9255-36ce98bdfea3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.239415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17905-b3f0-42fe-9255-36ce98bdfea3 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.240798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 12/24] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:05.251746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523c9f-b74a-4b3c-92bb-998d5d984c26 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.252044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523c9f-b74a-4b3c-92bb-998d5d984c26 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.252324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63523c9f-b74a-4b3c-92bb-998d5d984c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.295600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-63523c9f-b74a-4b3c-92bb-998d5d984c26 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:05.297542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-63523c9f-b74a-4b3c-92bb-998d5d984c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:05.335105 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29218082-4a25-403d-8166-188f697bbeb2 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.349558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:05.410618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a421982-ecb3-4976-8fb9-9d530a3e94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.411813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421982-ecb3-4976-8fb9-9d530a3e94fa None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.412298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421982-ecb3-4976-8fb9-9d530a3e94fa None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.414229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a421982-ecb3-4976-8fb9-9d530a3e94fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.445900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421982-ecb3-4976-8fb9-9d530a3e94fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.447625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a421982-ecb3-4976-8fb9-9d530a3e94fa None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:05.454546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 13/25] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:05.454546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229caa-a12d-4b1a-82d2-4eb288a2df30 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.454546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229caa-a12d-4b1a-82d2-4eb288a2df30 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.454546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229caa-a12d-4b1a-82d2-4eb288a2df30 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.455685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 14/26] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:05.456710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca474-a41f-47f6-b84b-d10a8f9438a4 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.457095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca474-a41f-47f6-b84b-d10a8f9438a4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.457472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ca474-a41f-47f6-b84b-d10a8f9438a4 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.460364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 15/27] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:05.466559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e306f-16ee-42d2-bde4-8fc88ebdabe0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.466559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e306f-16ee-42d2-bde4-8fc88ebdabe0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.466559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e306f-16ee-42d2-bde4-8fc88ebdabe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.483722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8a8e306f-16ee-42d2-bde4-8fc88ebdabe0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:05.485961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8a8e306f-16ee-42d2-bde4-8fc88ebdabe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-6a421982-ecb3-4976-8fb9-9d530a3e94fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:24:05.499525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:05.500430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:05.501201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:24:05.501201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:24:05.501201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:24:05.501201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:05.503151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 13/28] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:05.510713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f90d-1cb0-4dea-8d39-897234f30d86 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.511324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f90d-1cb0-4dea-8d39-897234f30d86 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.511801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03f90d-1cb0-4dea-8d39-897234f30d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.530851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-cc03f90d-1cb0-4dea-8d39-897234f30d86 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:05.532832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cc03f90d-1cb0-4dea-8d39-897234f30d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:05.544466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:05.580660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 16/29] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:05.581884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e306f-16ee-42d2-bde4-8fc88ebdabe0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:05.643446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 14/30] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:05.644318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03f90d-1cb0-4dea-8d39-897234f30d86 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:05.688629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:05.701210 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e306f-16ee-42d2-bde4-8fc88ebdabe0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.736882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.737848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.738325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.738797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.739714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:05.740204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.741771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:05.755079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 17/31] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:05.756271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:05.760758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03f90d-1cb0-4dea-8d39-897234f30d86 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.802463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a263115-af4a-4506-924c-28406bd4f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.803362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263115-af4a-4506-924c-28406bd4f5dd None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.803671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263115-af4a-4506-924c-28406bd4f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.803973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a263115-af4a-4506-924c-28406bd4f5dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.817333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a263115-af4a-4506-924c-28406bd4f5dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-2a263115-af4a-4506-924c-28406bd4f5dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:05.825678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:05.826545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:05.827453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 15/32] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:05.828503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a263115-af4a-4506-924c-28406bd4f5dd None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:05.832528 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:05.869126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63e7f7-1919-415b-9016-9240c62a41e9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.905620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9c04-c666-4618-9e39-311cc8e4fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.907238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9c04-c666-4618-9e39-311cc8e4fdaf None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.907676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9c04-c666-4618-9e39-311cc8e4fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.908083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd9c04-c666-4618-9e39-311cc8e4fdaf None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.908987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9c04-c666-4618-9e39-311cc8e4fdaf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.910517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd9c04-c666-4618-9e39-311cc8e4fdaf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:05.949052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a263115-af4a-4506-924c-28406bd4f5dd None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:05.987483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c3e9c-36d5-46fc-9278-993639436dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:05.988168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c3e9c-36d5-46fc-9278-993639436dbd None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:05.988479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c3e9c-36d5-46fc-9278-993639436dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:05.988752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947c3e9c-36d5-46fc-9278-993639436dbd None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:05.989484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c3e9c-36d5-46fc-9278-993639436dbd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:05.990928 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947c3e9c-36d5-46fc-9278-993639436dbd None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.172658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 18/33] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 26 12:24:05 2022] POST /identity/v3/roles => generated 225 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:06.175085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9c04-c666-4618-9e39-311cc8e4fdaf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.203056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.313540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 16/34] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 26 12:24:05 2022] POST /identity/v3/roles => generated 219 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:06.326563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c3e9c-36d5-46fc-9278-993639436dbd None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.397622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd9c04-c666-4618-9e39-311cc8e4fdaf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.463945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693c152c-1c7f-4341-85f3-4368e7132092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.466778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c152c-1c7f-4341-85f3-4368e7132092 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.467726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c152c-1c7f-4341-85f3-4368e7132092 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.470736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693c152c-1c7f-4341-85f3-4368e7132092 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.471790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c152c-1c7f-4341-85f3-4368e7132092 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.473650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693c152c-1c7f-4341-85f3-4368e7132092 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.502548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.569315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947c3e9c-36d5-46fc-9278-993639436dbd None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.612607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86533670-f73f-4e6b-8a8f-fb1611e3140f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.613322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86533670-f73f-4e6b-8a8f-fb1611e3140f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.613606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86533670-f73f-4e6b-8a8f-fb1611e3140f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.613883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86533670-f73f-4e6b-8a8f-fb1611e3140f None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.614686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86533670-f73f-4e6b-8a8f-fb1611e3140f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:06.614993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86533670-f73f-4e6b-8a8f-fb1611e3140f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.616505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86533670-f73f-4e6b-8a8f-fb1611e3140f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.631149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 17/35] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:06.634057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07b3d-ad4f-4f73-bf45-ea4ce1fd51ff None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.634173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 19/36] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/projects => generated 301 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:06.634692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07b3d-ad4f-4f73-bf45-ea4ce1fd51ff None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.635190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d07b3d-ad4f-4f73-bf45-ea4ce1fd51ff None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.635621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d537406-8227-460b-8b2f-6bffd8560d3c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.635916 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d537406-8227-460b-8b2f-6bffd8560d3c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.636201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d537406-8227-460b-8b2f-6bffd8560d3c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.637755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 20/37] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:06.637869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 18/38] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:06.643985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086646ce-895e-414f-8401-561b2526c8d5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.644292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d366-b782-4f69-bf0a-eb3be11f3eb0 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.644485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d366-b782-4f69-bf0a-eb3be11f3eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.644575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086646ce-895e-414f-8401-561b2526c8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.644771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033d366-b782-4f69-bf0a-eb3be11f3eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.644862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086646ce-895e-414f-8401-561b2526c8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.664920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-d033d366-b782-4f69-bf0a-eb3be11f3eb0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:06.667529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d033d366-b782-4f69-bf0a-eb3be11f3eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:06.668009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-086646ce-895e-414f-8401-561b2526c8d5 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:06.669635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-086646ce-895e-414f-8401-561b2526c8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:06.743786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.758503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 19/39] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:06.758503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d366-b782-4f69-bf0a-eb3be11f3eb0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.766712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 21/40] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:06.787311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086646ce-895e-414f-8401-561b2526c8d5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.836024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:06.896894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033d366-b782-4f69-bf0a-eb3be11f3eb0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.926351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086646ce-895e-414f-8401-561b2526c8d5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:06.932783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75a63-c394-4fd5-8bdc-ac7304c671bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.933777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75a63-c394-4fd5-8bdc-ac7304c671bb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.934068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75a63-c394-4fd5-8bdc-ac7304c671bb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.934349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf75a63-c394-4fd5-8bdc-ac7304c671bb None admin] PATH_INFO: `/v3/users/bc7504a99e7249a395b2c1252117a52e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.935585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf75a63-c394-4fd5-8bdc-ac7304c671bb None admin] RBAC: Authorizing `identity:get_user(user_id=bc7504a99e7249a395b2c1252117a52e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.937147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf75a63-c394-4fd5-8bdc-ac7304c671bb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:06.938815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 20/41] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/users/bc7504a99e7249a395b2c1252117a52e => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:06.939521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75a63-c394-4fd5-8bdc-ac7304c671bb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:06.964330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d1fb0-4799-4a99-8746-ccd26030f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:06.965013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d1fb0-4799-4a99-8746-ccd26030f028 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:06.965300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d1fb0-4799-4a99-8746-ccd26030f028 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:06.965580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d1fb0-4799-4a99-8746-ccd26030f028 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:06.966392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d1fb0-4799-4a99-8746-ccd26030f028 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:06.967808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d1fb0-4799-4a99-8746-ccd26030f028 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.043271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf75a63-c394-4fd5-8bdc-ac7304c671bb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.066348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.076664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7e700-43cd-4e8e-89f1-3cab795cd727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.078255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e700-43cd-4e8e-89f1-3cab795cd727 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.078546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e700-43cd-4e8e-89f1-3cab795cd727 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.078833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7e700-43cd-4e8e-89f1-3cab795cd727 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.080000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7e700-43cd-4e8e-89f1-3cab795cd727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.081467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c7e700-43cd-4e8e-89f1-3cab795cd727 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.083212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 21/42] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:07.083958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7e700-43cd-4e8e-89f1-3cab795cd727 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.117715 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 22/43] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 26 12:24:06 2022] POST /identity/v3/roles => generated 223 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:24:07.118564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d1fb0-4799-4a99-8746-ccd26030f028 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.199693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.214681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7e700-43cd-4e8e-89f1-3cab795cd727 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.261019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda62f0-b82e-400f-b7b0-143e8f2a6671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.261019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda62f0-b82e-400f-b7b0-143e8f2a6671 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.261019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda62f0-b82e-400f-b7b0-143e8f2a6671 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.261019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda62f0-b82e-400f-b7b0-143e8f2a6671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.262588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda62f0-b82e-400f-b7b0-143e8f2a6671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.263622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda62f0-b82e-400f-b7b0-143e8f2a6671 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.266144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 22/44] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:07.271394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d1fb0-4799-4a99-8746-ccd26030f028 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.271899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda62f0-b82e-400f-b7b0-143e8f2a6671 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:07.312635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d885e280-f2f3-438d-975e-cb3b3e8a327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.313237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e280-f2f3-438d-975e-cb3b3e8a327f None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.313511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e280-f2f3-438d-975e-cb3b3e8a327f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.313787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885e280-f2f3-438d-975e-cb3b3e8a327f None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.314571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885e280-f2f3-438d-975e-cb3b3e8a327f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.316096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d885e280-f2f3-438d-975e-cb3b3e8a327f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.347604 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:07.390783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda62f0-b82e-400f-b7b0-143e8f2a6671 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:07.424898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3889cd-f9f4-48d7-975b-927e3dd653f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:07.425802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3889cd-f9f4-48d7-975b-927e3dd653f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:07.426086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3889cd-f9f4-48d7-975b-927e3dd653f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:07.426375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3889cd-f9f4-48d7-975b-927e3dd653f3 None admin] PATH_INFO: `/v3/domains/default/users/bc7504a99e7249a395b2c1252117a52e/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:07.428420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3889cd-f9f4-48d7-975b-927e3dd653f3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bc7504a99e7249a395b2c1252117a52e, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:07.429933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3889cd-f9f4-48d7-975b-927e3dd653f3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:07.454887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 23/45] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:24:07 2022] POST /identity/v3/projects => generated 312 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:07.559057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 23/46] 10.222.0.60 () {58 vars in 1361 bytes} [Thu May 26 12:24:07 2022] PUT /identity/v3/domains/default/users/bc7504a99e7249a395b2c1252117a52e/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:24:09.714913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76476dbf-5ded-48e4-b7ff-e4ee7937cd13 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.715439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76476dbf-5ded-48e4-b7ff-e4ee7937cd13 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.715544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76476dbf-5ded-48e4-b7ff-e4ee7937cd13 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.716959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 24/47] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:09.722831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeacdc-3e86-4d4c-a234-d3fbb126f18d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.723274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeacdc-3e86-4d4c-a234-d3fbb126f18d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.723372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aeacdc-3e86-4d4c-a234-d3fbb126f18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.740297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-88aeacdc-3e86-4d4c-a234-d3fbb126f18d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:09.741482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-88aeacdc-3e86-4d4c-a234-d3fbb126f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:09.778453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1fb7c-8682-44ed-92a6-ba829bc05957 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.778772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1fb7c-8682-44ed-92a6-ba829bc05957 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.779085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1fb7c-8682-44ed-92a6-ba829bc05957 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.781137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 25/48] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:09.786648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01f071-35c2-4a7a-a611-bdd1f52b1cb7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.787248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01f071-35c2-4a7a-a611-bdd1f52b1cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.787248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01f071-35c2-4a7a-a611-bdd1f52b1cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.803656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2f01f071-35c2-4a7a-a611-bdd1f52b1cb7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:09.804847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2f01f071-35c2-4a7a-a611-bdd1f52b1cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:09.812825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 24/49] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:09.837173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeacdc-3e86-4d4c-a234-d3fbb126f18d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.877383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 26/50] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:09.889106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:09.902011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01f071-35c2-4a7a-a611-bdd1f52b1cb7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:09.933688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:09.941661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aeacdc-3e86-4d4c-a234-d3fbb126f18d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:09.976200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b1419-3a47-45b7-98e9-a432f86fb7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:09.976922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1419-3a47-45b7-98e9-a432f86fb7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:09.977205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1419-3a47-45b7-98e9-a432f86fb7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:09.977482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b1419-3a47-45b7-98e9-a432f86fb7d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:09.978804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b1419-3a47-45b7-98e9-a432f86fb7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:09.980247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b1419-3a47-45b7-98e9-a432f86fb7d7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:09.981915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 25/51] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:09.987721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b1419-3a47-45b7-98e9-a432f86fb7d7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.003539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01f071-35c2-4a7a-a611-bdd1f52b1cb7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.039224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f47f-6825-4564-bc0a-ada66f62cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.040021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f47f-6825-4564-bc0a-ada66f62cca2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.040337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f47f-6825-4564-bc0a-ada66f62cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.040591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26f47f-6825-4564-bc0a-ada66f62cca2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.051807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26f47f-6825-4564-bc0a-ada66f62cca2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3e26f47f-6825-4564-bc0a-ada66f62cca2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:10.061171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:10.062050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:10.062886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 27/52] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:10.069383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f47f-6825-4564-bc0a-ada66f62cca2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.091751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b1419-3a47-45b7-98e9-a432f86fb7d7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.109228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.128927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd46ce0-3cd1-4a2c-bbe6-bfee5b6543c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.129597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd46ce0-3cd1-4a2c-bbe6-bfee5b6543c9 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.129960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd46ce0-3cd1-4a2c-bbe6-bfee5b6543c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.130229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd46ce0-3cd1-4a2c-bbe6-bfee5b6543c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.130999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd46ce0-3cd1-4a2c-bbe6-bfee5b6543c9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.132501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd46ce0-3cd1-4a2c-bbe6-bfee5b6543c9 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.170227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.180358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26f47f-6825-4564-bc0a-ada66f62cca2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.217172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.217880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.218158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.218431 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.219224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:10.219525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.220998 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.234588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 28/53] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:10.240042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.293535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 26/54] 10.222.0.60 () {60 vars in 1140 bytes} [Thu May 26 12:24:09 2022] POST /identity/v3/projects => generated 298 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:24:10.347845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514585b-219b-4b2a-b1cb-e7a02e7fa9a0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.386574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1e0f-cfe7-4771-8296-3ff0ab332898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.387484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1e0f-cfe7-4771-8296-3ff0ab332898 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.387770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1e0f-cfe7-4771-8296-3ff0ab332898 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.388056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1e0f-cfe7-4771-8296-3ff0ab332898 None admin] PATH_INFO: `/v3/users/bc7504a99e7249a395b2c1252117a52e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.389433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de1e0f-cfe7-4771-8296-3ff0ab332898 None admin] RBAC: Authorizing `identity:get_user(user_id=bc7504a99e7249a395b2c1252117a52e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.391813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de1e0f-cfe7-4771-8296-3ff0ab332898 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.393531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 29/55] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/users/bc7504a99e7249a395b2c1252117a52e => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:10.399596 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd46ce0-3cd1-4a2c-bbe6-bfee5b6543c9 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.509686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd46ce0-3cd1-4a2c-bbe6-bfee5b6543c9 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.543632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173e0eb-acc7-4a02-9291-2e6ea1e81613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.544425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e0eb-acc7-4a02-9291-2e6ea1e81613 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.544709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e0eb-acc7-4a02-9291-2e6ea1e81613 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.544982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173e0eb-acc7-4a02-9291-2e6ea1e81613 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.546659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173e0eb-acc7-4a02-9291-2e6ea1e81613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.548089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a173e0eb-acc7-4a02-9291-2e6ea1e81613 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.549699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 27/56] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:10.555633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1e0f-cfe7-4771-8296-3ff0ab332898 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:10.580562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:10.657849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1e0f-cfe7-4771-8296-3ff0ab332898 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:10.693192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e4b26-c908-4f47-a88e-ec2f37c5f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:10.693783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e4b26-c908-4f47-a88e-ec2f37c5f622 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:10.694070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e4b26-c908-4f47-a88e-ec2f37c5f622 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:10.694349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e4b26-c908-4f47-a88e-ec2f37c5f622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:10.695251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e4b26-c908-4f47-a88e-ec2f37c5f622 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.domain.id=default, user.id=bc7504a99e7249a395b2c1252117a52e) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:10.695562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e4b26-c908-4f47-a88e-ec2f37c5f622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:10.697012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e4b26-c908-4f47-a88e-ec2f37c5f622 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:10.703560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 30/57] 10.222.0.60 () {56 vars in 1322 bytes} [Thu May 26 12:24:10 2022] GET /identity/v3/role_assignments?user.id=bc7504a99e7249a395b2c1252117a52e&scope.domain.id=default&role.id=07de3e1931ca4d799df8510428e181aa => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:12.569797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9abd1-56a0-41b0-8bab-688b4a965fc6 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.570287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9abd1-56a0-41b0-8bab-688b4a965fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.570287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9abd1-56a0-41b0-8bab-688b4a965fc6 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.571691 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 28/58] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:12.577223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03b4bb-95ee-4bd2-a35a-4cb92ae52bd2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.577720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03b4bb-95ee-4bd2-a35a-4cb92ae52bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.577834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03b4bb-95ee-4bd2-a35a-4cb92ae52bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.598146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ff03b4bb-95ee-4bd2-a35a-4cb92ae52bd2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:12.599550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ff03b4bb-95ee-4bd2-a35a-4cb92ae52bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:12.674411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 31/59] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:12.698652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9abd1-56a0-41b0-8bab-688b4a965fc6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.744282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.806223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9abd1-56a0-41b0-8bab-688b4a965fc6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.840537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b3f32-5a42-4b5b-8e20-89c61ff1605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.841254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b3f32-5a42-4b5b-8e20-89c61ff1605b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.841541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b3f32-5a42-4b5b-8e20-89c61ff1605b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.841818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b3f32-5a42-4b5b-8e20-89c61ff1605b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.843735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b3f32-5a42-4b5b-8e20-89c61ff1605b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.845196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b3f32-5a42-4b5b-8e20-89c61ff1605b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:12.846869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 29/60] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:12.852855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03b4bb-95ee-4bd2-a35a-4cb92ae52bd2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:12.870704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:12.952517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03b4bb-95ee-4bd2-a35a-4cb92ae52bd2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:12.987043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69702d-5515-48a7-ac9f-62e311d7d8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:12.987716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69702d-5515-48a7-ac9f-62e311d7d8a5 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:12.988003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69702d-5515-48a7-ac9f-62e311d7d8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:12.988284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69702d-5515-48a7-ac9f-62e311d7d8a5 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:12.988998 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69702d-5515-48a7-ac9f-62e311d7d8a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:12.990452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69702d-5515-48a7-ac9f-62e311d7d8a5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:13.120875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 32/61] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:24:12 2022] POST /identity/v3/users => generated 275 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:16.758048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133edc4e-ca77-4e6f-8bc3-b69e6f0e6f22 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.759095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133edc4e-ca77-4e6f-8bc3-b69e6f0e6f22 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.759602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133edc4e-ca77-4e6f-8bc3-b69e6f0e6f22 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.761171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 30/62] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:16.767966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4530-dbb3-4b8d-bd0d-567b59325c2f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.768818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4530-dbb3-4b8d-bd0d-567b59325c2f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.769293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb4530-dbb3-4b8d-bd0d-567b59325c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.792142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a8b8e-af97-4098-a8ed-da33fa07fdbf None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.792756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a8b8e-af97-4098-a8ed-da33fa07fdbf None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.793247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a8b8e-af97-4098-a8ed-da33fa07fdbf None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.794835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:16.797819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d6cb4530-dbb3-4b8d-bd0d-567b59325c2f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:16.799328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d6cb4530-dbb3-4b8d-bd0d-567b59325c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:16.801310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6fe24-3e8f-4570-b1fb-ace0e83cf05e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.801811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6fe24-3e8f-4570-b1fb-ace0e83cf05e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.802279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b6fe24-3e8f-4570-b1fb-ace0e83cf05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.834186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-76b6fe24-3e8f-4570-b1fb-ace0e83cf05e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:16.835782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-76b6fe24-3e8f-4570-b1fb-ace0e83cf05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:16.885952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 33/64] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:16.887361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac271-314c-463a-80e3-5a8310da5a5b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.887813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac271-314c-463a-80e3-5a8310da5a5b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.888235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7ac271-314c-463a-80e3-5a8310da5a5b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.890894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 34/65] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:16.904155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51631-d9e1-4e7a-b0d5-dfed4f60de00 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:16.904813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51631-d9e1-4e7a-b0d5-dfed4f60de00 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:16.905453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51631-d9e1-4e7a-b0d5-dfed4f60de00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:16.914990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:16.928452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9ed51631-d9e1-4e7a-b0d5-dfed4f60de00 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:16.929999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9ed51631-d9e1-4e7a-b0d5-dfed4f60de00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:16.936009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 32/66] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 12:24:16.938139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6fe24-3e8f-4570-b1fb-ace0e83cf05e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.007043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 35/67] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:17.007702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.009966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed51631-d9e1-4e7a-b0d5-dfed4f60de00 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.125428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b6fe24-3e8f-4570-b1fb-ace0e83cf05e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.148649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed51631-d9e1-4e7a-b0d5-dfed4f60de00 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.188696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.194073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535a143-9be9-4934-b35a-da7bd5398744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.194721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabe1999-66ef-49ec-98e6-4617756a41eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.195372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a143-9be9-4934-b35a-da7bd5398744 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.195750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a143-9be9-4934-b35a-da7bd5398744 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.196123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535a143-9be9-4934-b35a-da7bd5398744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.196831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe1999-66ef-49ec-98e6-4617756a41eb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.197385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe1999-66ef-49ec-98e6-4617756a41eb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.197819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe1999-66ef-49ec-98e6-4617756a41eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.210453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535a143-9be9-4934-b35a-da7bd5398744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:17.213104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabe1999-66ef-49ec-98e6-4617756a41eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-f535a143-9be9-4934-b35a-da7bd5398744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:17.220017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.220908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:17.222083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 33/68] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-dabe1999-66ef-49ec-98e6-4617756a41eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:17.222965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.223730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:17.224472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:17.225031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535a143-9be9-4934-b35a-da7bd5398744 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.225096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 36/69] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:17.225096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18083-38ef-4fc4-897b-aa5532b1458d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.225206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18083-38ef-4fc4-897b-aa5532b1458d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.226150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18083-38ef-4fc4-897b-aa5532b1458d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.227049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 37/70] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:17.228225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18083-38ef-4fc4-897b-aa5532b1458d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.334785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.341793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535a143-9be9-4934-b35a-da7bd5398744 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.350808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18083-38ef-4fc4-897b-aa5532b1458d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.377389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e8d83-af33-4c34-915a-a6e17f8d6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.378218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8d83-af33-4c34-915a-a6e17f8d6228 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.378500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8d83-af33-4c34-915a-a6e17f8d6228 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.378832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e8d83-af33-4c34-915a-a6e17f8d6228 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.385195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.385866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.386147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.386425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.387206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.387511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.388891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.388975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e8d83-af33-4c34-915a-a6e17f8d6228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-955e8d83-af33-4c34-915a-a6e17f8d6228 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:17.397712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.398672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:17.399428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:17.399995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 38/71] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.399995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.400110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 34/72] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:17.400180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbc332-0d64-49c6-a508-0c11adb05589 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.401385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbc332-0d64-49c6-a508-0c11adb05589 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.401385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbc332-0d64-49c6-a508-0c11adb05589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.418020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-05dbc332-0d64-49c6-a508-0c11adb05589 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:17.419238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-05dbc332-0d64-49c6-a508-0c11adb05589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:17.463377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.494625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 35/73] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:17.497221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6158-e83c-4755-8836-c3d07674416a None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.497479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6158-e83c-4755-8836-c3d07674416a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.497762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee6158-e83c-4755-8836-c3d07674416a None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.501239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 36/74] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:17.501239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee6158-e83c-4755-8836-c3d07674416a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.516579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c75ed-9775-457e-aa34-4934f7f94a5f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.554570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.555174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.555465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.555853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.556610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.556917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.558318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.567051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 39/75] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.567767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.593968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.615591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee6158-e83c-4755-8836-c3d07674416a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.651598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca2600-e3fa-459c-929b-978d94770695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.652274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2600-e3fa-459c-929b-978d94770695 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.652562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2600-e3fa-459c-929b-978d94770695 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.652843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca2600-e3fa-459c-929b-978d94770695 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.653595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca2600-e3fa-459c-929b-978d94770695 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:17.653907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca2600-e3fa-459c-929b-978d94770695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.655389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca2600-e3fa-459c-929b-978d94770695 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.663443 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 37/76] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.664921 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143413e4-1012-4582-9397-f262ef0b3dc8 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.665213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143413e4-1012-4582-9397-f262ef0b3dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.665491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143413e4-1012-4582-9397-f262ef0b3dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.672431 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f714e723-ac52-44ee-b551-e51fd7a90e9a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.681379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-143413e4-1012-4582-9397-f262ef0b3dc8 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:17.682582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-143413e4-1012-4582-9397-f262ef0b3dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:17.689193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.707249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672a497-da83-4702-aacb-9a94bef2804f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.708136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672a497-da83-4702-aacb-9a94bef2804f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.708422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672a497-da83-4702-aacb-9a94bef2804f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.708699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672a497-da83-4702-aacb-9a94bef2804f None admin] PATH_INFO: `/v3/users/bc7504a99e7249a395b2c1252117a52e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.709884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672a497-da83-4702-aacb-9a94bef2804f None admin] RBAC: Authorizing `identity:get_user(user_id=bc7504a99e7249a395b2c1252117a52e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.711374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f672a497-da83-4702-aacb-9a94bef2804f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.713050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 40/77] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users/bc7504a99e7249a395b2c1252117a52e => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.717719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672a497-da83-4702-aacb-9a94bef2804f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.755156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 38/78] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:17.755996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143413e4-1012-4582-9397-f262ef0b3dc8 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.816214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f672a497-da83-4702-aacb-9a94bef2804f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.836740 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.851199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824164-cbb4-4b15-9991-715a4d332315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.852009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824164-cbb4-4b15-9991-715a4d332315 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.852303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824164-cbb4-4b15-9991-715a4d332315 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.852581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2824164-cbb4-4b15-9991-715a4d332315 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.857922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143413e4-1012-4582-9397-f262ef0b3dc8 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:17.863648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2824164-cbb4-4b15-9991-715a4d332315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a2824164-cbb4-4b15-9991-715a4d332315 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:17.871685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:17.872513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:17.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 41/79] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:17.873913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824164-cbb4-4b15-9991-715a4d332315 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.895829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6b0b3-9b6a-442f-8f30-93cd0fb27a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:17.896705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6b0b3-9b6a-442f-8f30-93cd0fb27a56 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:17.896985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6b0b3-9b6a-442f-8f30-93cd0fb27a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:17.897255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6b0b3-9b6a-442f-8f30-93cd0fb27a56 None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:17.913183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6b0b3-9b6a-442f-8f30-93cd0fb27a56 None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:17.914663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6b0b3-9b6a-442f-8f30-93cd0fb27a56 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:17.920875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 39/80] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:17.920875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6b0b3-9b6a-442f-8f30-93cd0fb27a56 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:17.922849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:17.984222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2824164-cbb4-4b15-9991-715a4d332315 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.018945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e93df2-6369-4185-a72e-cc668be35af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.019832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e93df2-6369-4185-a72e-cc668be35af5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.020120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e93df2-6369-4185-a72e-cc668be35af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.020406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e93df2-6369-4185-a72e-cc668be35af5 None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.021626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e93df2-6369-4185-a72e-cc668be35af5 None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.023117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e93df2-6369-4185-a72e-cc668be35af5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.023978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6b0b3-9b6a-442f-8f30-93cd0fb27a56 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.024756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 42/81] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.025522 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e93df2-6369-4185-a72e-cc668be35af5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.064021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ea59e-cf8b-4a1d-9d3d-bde9e3c3e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.064678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ea59e-cf8b-4a1d-9d3d-bde9e3c3e460 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.064963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ea59e-cf8b-4a1d-9d3d-bde9e3c3e460 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.065240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5ea59e-cf8b-4a1d-9d3d-bde9e3c3e460 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.068801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.125346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e93df2-6369-4185-a72e-cc668be35af5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.134624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ea59e-cf8b-4a1d-9d3d-bde9e3c3e460 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.136109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5ea59e-cf8b-4a1d-9d3d-bde9e3c3e460 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.138750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.160304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c81b95-6ea3-4e78-b1ec-f5186af12e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.161109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c81b95-6ea3-4e78-b1ec-f5186af12e17 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.161498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c81b95-6ea3-4e78-b1ec-f5186af12e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.161782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c81b95-6ea3-4e78-b1ec-f5186af12e17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.162988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c81b95-6ea3-4e78-b1ec-f5186af12e17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.164437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c81b95-6ea3-4e78-b1ec-f5186af12e17 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.166063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 43/82] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.166856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c81b95-6ea3-4e78-b1ec-f5186af12e17 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.235379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 40/83] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:18.236227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ea59e-cf8b-4a1d-9d3d-bde9e3c3e460 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.270315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.271333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c81b95-6ea3-4e78-b1ec-f5186af12e17 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.306467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.307162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.307441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.307714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.308464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:18.308805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.310216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.319456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 44/84] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.320273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.342902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5ea59e-cf8b-4a1d-9d3d-bde9e3c3e460 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.363355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.383221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393cdfd-dd0e-4604-aaba-985e78df1c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.383868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393cdfd-dd0e-4604-aaba-985e78df1c21 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.384149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393cdfd-dd0e-4604-aaba-985e78df1c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.384424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393cdfd-dd0e-4604-aaba-985e78df1c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.423034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75cbc4-413a-46fc-b6d5-6f5a38fc2e20 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.452576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393cdfd-dd0e-4604-aaba-985e78df1c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.454045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393cdfd-dd0e-4604-aaba-985e78df1c21 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.456813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee210985-b5ea-4190-91fb-7c8c86cc7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.457467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210985-b5ea-4190-91fb-7c8c86cc7267 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.457746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210985-b5ea-4190-91fb-7c8c86cc7267 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.458030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee210985-b5ea-4190-91fb-7c8c86cc7267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.489558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.528118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee210985-b5ea-4190-91fb-7c8c86cc7267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.529593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee210985-b5ea-4190-91fb-7c8c86cc7267 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.555962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 41/85] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:18.556785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393cdfd-dd0e-4604-aaba-985e78df1c21 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.574547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.632206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 45/86] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:18.633257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee210985-b5ea-4190-91fb-7c8c86cc7267 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.659731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393cdfd-dd0e-4604-aaba-985e78df1c21 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.701013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57400c9-c4d5-4002-865b-0c94706db18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.701711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57400c9-c4d5-4002-865b-0c94706db18d None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.702116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57400c9-c4d5-4002-865b-0c94706db18d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.702652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57400c9-c4d5-4002-865b-0c94706db18d None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.703381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57400c9-c4d5-4002-865b-0c94706db18d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.704839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57400c9-c4d5-4002-865b-0c94706db18d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.715980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.751135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee210985-b5ea-4190-91fb-7c8c86cc7267 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.785877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8300f9-1fff-428b-9de2-b6c80abd2587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.786788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8300f9-1fff-428b-9de2-b6c80abd2587 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.787071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8300f9-1fff-428b-9de2-b6c80abd2587 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.787346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8300f9-1fff-428b-9de2-b6c80abd2587 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.788514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8300f9-1fff-428b-9de2-b6c80abd2587 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.789935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8300f9-1fff-428b-9de2-b6c80abd2587 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.791642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 46/87] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.792478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8300f9-1fff-428b-9de2-b6c80abd2587 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.804535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:18.811220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 42/88] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:24:18 2022] POST /identity/v3/users => generated 289 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:18.812053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57400c9-c4d5-4002-865b-0c94706db18d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.918212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8300f9-1fff-428b-9de2-b6c80abd2587 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.933155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57400c9-c4d5-4002-865b-0c94706db18d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:18.959270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1f36f-c2fc-47cb-9854-7003cf17e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.960196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1f36f-c2fc-47cb-9854-7003cf17e8ed None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.960525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1f36f-c2fc-47cb-9854-7003cf17e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.960751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1f36f-c2fc-47cb-9854-7003cf17e8ed None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.962081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1f36f-c2fc-47cb-9854-7003cf17e8ed None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.963644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1f36f-c2fc-47cb-9854-7003cf17e8ed None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.970921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 47/89] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.970921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1f36f-c2fc-47cb-9854-7003cf17e8ed None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:18.981887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c421d82-c616-4cc0-be4d-29477f966ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:18.983036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c421d82-c616-4cc0-be4d-29477f966ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:18.983317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c421d82-c616-4cc0-be4d-29477f966ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:18.983587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c421d82-c616-4cc0-be4d-29477f966ed0 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:18.984863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c421d82-c616-4cc0-be4d-29477f966ed0 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:18.986350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c421d82-c616-4cc0-be4d-29477f966ed0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:18.993014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 43/90] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:18.993014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c421d82-c616-4cc0-be4d-29477f966ed0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.074403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.075912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.103259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1f36f-c2fc-47cb-9854-7003cf17e8ed None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.135050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c421d82-c616-4cc0-be4d-29477f966ed0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.146666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dec0d-4206-4f24-b814-5f1ac323e703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.147810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dec0d-4206-4f24-b814-5f1ac323e703 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.148109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dec0d-4206-4f24-b814-5f1ac323e703 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.148397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65dec0d-4206-4f24-b814-5f1ac323e703 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.149655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dec0d-4206-4f24-b814-5f1ac323e703 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.151425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65dec0d-4206-4f24-b814-5f1ac323e703 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.153918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 48/91] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.155399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dec0d-4206-4f24-b814-5f1ac323e703 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.183633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.184322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.184679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.185030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.186450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=3c571faec99847838c665f0fa1909346, user.id=bc7504a99e7249a395b2c1252117a52e) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.186925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.188375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.199815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 44/92] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:18 2022] GET /identity/v3/role_assignments?user.id=bc7504a99e7249a395b2c1252117a52e&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=07de3e1931ca4d799df8510428e181aa => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.200542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.331967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65dec0d-4206-4f24-b814-5f1ac323e703 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.403097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e65bbb2-1aef-4471-9f99-ee0e8f5144d7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.410500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c549-1d1c-4ea5-b7b0-27f7f80127b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.411353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c549-1d1c-4ea5-b7b0-27f7f80127b5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.411646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c549-1d1c-4ea5-b7b0-27f7f80127b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.411928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7c549-1d1c-4ea5-b7b0-27f7f80127b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.435424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.443262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.451245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.452265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.452556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.457101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.457101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] RBAC: Adding query filter params (role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=3c571faec99847838c665f0fa1909346, user.id=839d126470c7460e8379a9881d54b5ce) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.457101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.457101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.462992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 45/93] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/role_assignments?user.id=839d126470c7460e8379a9881d54b5ce&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.463981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.559752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7c549-1d1c-4ea5-b7b0-27f7f80127b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.566623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7c549-1d1c-4ea5-b7b0-27f7f80127b5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.601711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daac1579-67e7-4c6d-877c-3a2527848245 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.647760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.648444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.648730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.649009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.650243 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] RBAC: Adding query filter params (role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=3c571faec99847838c665f0fa1909346, user.id=839d126470c7460e8379a9881d54b5ce) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:19.650840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.652964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.661601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 46/94] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/role_assignments?user.id=839d126470c7460e8379a9881d54b5ce&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.761459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 49/95] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:19.768806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:19.836454 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:19.890735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf64e5-1ae3-4d6a-8d3d-f35091b53149 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:19.928590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf164f-351b-4d2c-bc33-fedfcbbacbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:19.929487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf164f-351b-4d2c-bc33-fedfcbbacbbf None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:19.929892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf164f-351b-4d2c-bc33-fedfcbbacbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:19.930189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf164f-351b-4d2c-bc33-fedfcbbacbbf None admin] PATH_INFO: `/v3/projects/edc7d0c845b94817a1f39e8b90989f48` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:19.931515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf164f-351b-4d2c-bc33-fedfcbbacbbf None admin] RBAC: Authorizing `identity:get_project(project_id=edc7d0c845b94817a1f39e8b90989f48)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:19.933006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf164f-351b-4d2c-bc33-fedfcbbacbbf None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:19.934811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 47/96] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/projects/edc7d0c845b94817a1f39e8b90989f48 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:19.943683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c549-1d1c-4ea5-b7b0-27f7f80127b5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:20.018624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:20.089610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7c549-1d1c-4ea5-b7b0-27f7f80127b5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:20.129469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bd4f1-d63c-4ed3-a36d-c0d5b8bf7d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:20.130183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd4f1-d63c-4ed3-a36d-c0d5b8bf7d2f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:20.130661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd4f1-d63c-4ed3-a36d-c0d5b8bf7d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:20.131011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bd4f1-d63c-4ed3-a36d-c0d5b8bf7d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:20.132451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bd4f1-d63c-4ed3-a36d-c0d5b8bf7d2f None admin] RBAC: Adding query filter params (role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=edc7d0c845b94817a1f39e8b90989f48, user.id=839d126470c7460e8379a9881d54b5ce) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:20.132921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bd4f1-d63c-4ed3-a36d-c0d5b8bf7d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:20.135011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bd4f1-d63c-4ed3-a36d-c0d5b8bf7d2f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:20.142379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 50/97] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:19 2022] GET /identity/v3/role_assignments?user.id=839d126470c7460e8379a9881d54b5ce&scope.project.id=edc7d0c845b94817a1f39e8b90989f48&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:21.937791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95bc2b-dd2b-4384-8188-c55bef84e3bb None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.938835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95bc2b-dd2b-4384-8188-c55bef84e3bb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.939329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95bc2b-dd2b-4384-8188-c55bef84e3bb None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.940950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 48/98] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:21.946706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568babe7-402e-4c07-b59a-ec4676446b52 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:21.947616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568babe7-402e-4c07-b59a-ec4676446b52 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:21.948096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568babe7-402e-4c07-b59a-ec4676446b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:21.978767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-568babe7-402e-4c07-b59a-ec4676446b52 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:21.980305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-568babe7-402e-4c07-b59a-ec4676446b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:22.077573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 51/99] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:22.117094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95bc2b-dd2b-4384-8188-c55bef84e3bb None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.244864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95bc2b-dd2b-4384-8188-c55bef84e3bb None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.267509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.286052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd0ea7-3b32-4650-9ad7-3b4b865e1a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.286052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0ea7-3b32-4650-9ad7-3b4b865e1a26 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.286052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0ea7-3b32-4650-9ad7-3b4b865e1a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.286343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd0ea7-3b32-4650-9ad7-3b4b865e1a26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.299074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cd0ea7-3b32-4650-9ad7-3b4b865e1a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-24cd0ea7-3b32-4650-9ad7-3b4b865e1a26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:22.307236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:22.308116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:22.308908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 49/100] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:22.314513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd0ea7-3b32-4650-9ad7-3b4b865e1a26 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.314848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe041-25aa-4f4e-be62-ce9b649cd9fb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.323746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe041-25aa-4f4e-be62-ce9b649cd9fb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.323746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afe041-25aa-4f4e-be62-ce9b649cd9fb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.323746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 52/101] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:22.323746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5be008-9b49-4f82-afd3-319eb29169a1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.323746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5be008-9b49-4f82-afd3-319eb29169a1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.324164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5be008-9b49-4f82-afd3-319eb29169a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.429525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bf5be008-9b49-4f82-afd3-319eb29169a1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:22.439308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bf5be008-9b49-4f82-afd3-319eb29169a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:22.512602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.577687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 53/102] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:22.610563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd0ea7-3b32-4650-9ad7-3b4b865e1a26 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.620250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5be008-9b49-4f82-afd3-319eb29169a1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.675802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126351c-0427-4e0c-918e-654fc8e95f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.676695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126351c-0427-4e0c-918e-654fc8e95f04 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.676982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126351c-0427-4e0c-918e-654fc8e95f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.677259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126351c-0427-4e0c-918e-654fc8e95f04 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.678026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126351c-0427-4e0c-918e-654fc8e95f04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:22.678339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126351c-0427-4e0c-918e-654fc8e95f04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.679769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126351c-0427-4e0c-918e-654fc8e95f04 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.705660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 50/103] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:22.706887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac3be-1768-488c-a859-196d3e2a18ef None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.709777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac3be-1768-488c-a859-196d3e2a18ef None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.710155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbac3be-1768-488c-a859-196d3e2a18ef None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.713278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 51/104] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:22.714057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbac3be-1768-488c-a859-196d3e2a18ef None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:22.809051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5be008-9b49-4f82-afd3-319eb29169a1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.842985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.879185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc88a188-560f-4b8c-98fe-900fb76eaae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.880945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a188-560f-4b8c-98fe-900fb76eaae0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.881233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a188-560f-4b8c-98fe-900fb76eaae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.881510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88a188-560f-4b8c-98fe-900fb76eaae0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.882780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88a188-560f-4b8c-98fe-900fb76eaae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:22.884274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc88a188-560f-4b8c-98fe-900fb76eaae0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:22.885978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 54/105] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:22.887572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7794f6-9129-4c9d-a9dc-0c2088fb2d0d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.888100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7794f6-9129-4c9d-a9dc-0c2088fb2d0d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:22.888687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7794f6-9129-4c9d-a9dc-0c2088fb2d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:22.919150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6d7794f6-9129-4c9d-a9dc-0c2088fb2d0d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:22.921853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6d7794f6-9129-4c9d-a9dc-0c2088fb2d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:22.954798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbac3be-1768-488c-a859-196d3e2a18ef None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:22.961185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:22.996291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a2eb-a838-4f31-a56c-9130092aeff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:22.997689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a2eb-a838-4f31-a56c-9130092aeff4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:22.999117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a2eb-a838-4f31-a56c-9130092aeff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.000137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a2eb-a838-4f31-a56c-9130092aeff4 None admin] PATH_INFO: `/v3/users/aba76b5071ad45debc33032ede796ee3` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.012318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 55/106] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:23.014104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcd2ea-3eeb-4018-afcd-1f6e7aade5aa None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.014720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcd2ea-3eeb-4018-afcd-1f6e7aade5aa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.014720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bcd2ea-3eeb-4018-afcd-1f6e7aade5aa None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.017241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 56/107] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:23.017913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcd2ea-3eeb-4018-afcd-1f6e7aade5aa None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.018514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9a2eb-a838-4f31-a56c-9130092aeff4 None admin] RBAC: Authorizing `identity:get_user(user_id=aba76b5071ad45debc33032ede796ee3)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.020308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9a2eb-a838-4f31-a56c-9130092aeff4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.022709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 52/108] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:22 2022] GET /identity/v3/users/aba76b5071ad45debc33032ede796ee3 => generated 289 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.024226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c53ee-040c-4a29-a277-f18cab48e007 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.024768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c53ee-040c-4a29-a277-f18cab48e007 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.025499 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c53ee-040c-4a29-a277-f18cab48e007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.071337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b49c53ee-040c-4a29-a277-f18cab48e007 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:23.071337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b49c53ee-040c-4a29-a277-f18cab48e007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:23.149311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 53/109] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:23.150821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c53ee-040c-4a29-a277-f18cab48e007 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.168274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bcd2ea-3eeb-4018-afcd-1f6e7aade5aa None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.184973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.221367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100650a7-c5a3-48de-9b58-ba87ccd70f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.222049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100650a7-c5a3-48de-9b58-ba87ccd70f8b None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.222391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100650a7-c5a3-48de-9b58-ba87ccd70f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.222712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100650a7-c5a3-48de-9b58-ba87ccd70f8b None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.223488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100650a7-c5a3-48de-9b58-ba87ccd70f8b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.225025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100650a7-c5a3-48de-9b58-ba87ccd70f8b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.274471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c53ee-040c-4a29-a277-f18cab48e007 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.318228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7acebe-838d-4d51-a196-85685fb1fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.319110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acebe-838d-4d51-a196-85685fb1fec4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.319527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acebe-838d-4d51-a196-85685fb1fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.319831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7acebe-838d-4d51-a196-85685fb1fec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.329482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 57/110] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:24:23 2022] POST /identity/v3/projects => generated 302 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:23.329482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100650a7-c5a3-48de-9b58-ba87ccd70f8b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.361746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.435550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7acebe-838d-4d51-a196-85685fb1fec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.438003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7acebe-838d-4d51-a196-85685fb1fec4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.484924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.486648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100650a7-c5a3-48de-9b58-ba87ccd70f8b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.538423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7f566-ca6d-4e2c-b46d-52f36309a178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.539645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f566-ca6d-4e2c-b46d-52f36309a178 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.540151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f566-ca6d-4e2c-b46d-52f36309a178 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.540638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7f566-ca6d-4e2c-b46d-52f36309a178 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.556218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7f566-ca6d-4e2c-b46d-52f36309a178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a6f7f566-ca6d-4e2c-b46d-52f36309a178 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:23.567337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:23.568229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:23.568968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:23.572975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 58/111] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:23.574465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7f566-ca6d-4e2c-b46d-52f36309a178 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.584135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 54/112] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:23.585520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593f21-1e77-41be-bb62-4a787447d001 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.585852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593f21-1e77-41be-bb62-4a787447d001 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.591313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66593f21-1e77-41be-bb62-4a787447d001 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.594151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 55/113] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:23.594923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66593f21-1e77-41be-bb62-4a787447d001 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.712760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.732405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7f566-ca6d-4e2c-b46d-52f36309a178 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.743092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66593f21-1e77-41be-bb62-4a787447d001 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.772599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446a079-02b5-476f-8399-7de9cdac75d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.773578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446a079-02b5-476f-8399-7de9cdac75d8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.773866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446a079-02b5-476f-8399-7de9cdac75d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.774147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446a079-02b5-476f-8399-7de9cdac75d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.783171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:23.788618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446a079-02b5-476f-8399-7de9cdac75d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:23.789011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d79cdb-df6c-4abc-a68d-872ee9b8d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.789765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79cdb-df6c-4abc-a68d-872ee9b8d24e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.790260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79cdb-df6c-4abc-a68d-872ee9b8d24e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.790753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d79cdb-df6c-4abc-a68d-872ee9b8d24e None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.791572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79cdb-df6c-4abc-a68d-872ee9b8d24e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:23.799296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79cdb-df6c-4abc-a68d-872ee9b8d24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.799296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d79cdb-df6c-4abc-a68d-872ee9b8d24e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7446a079-02b5-476f-8399-7de9cdac75d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:23.799478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:23.800256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 59/114] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:23.801004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446a079-02b5-476f-8399-7de9cdac75d8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.808351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 56/115] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.809793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170aca7-bf1a-4ef8-bf46-52f49314b73f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.810083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170aca7-bf1a-4ef8-bf46-52f49314b73f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.810916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d170aca7-bf1a-4ef8-bf46-52f49314b73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.827586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-d170aca7-bf1a-4ef8-bf46-52f49314b73f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:23.828765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d170aca7-bf1a-4ef8-bf46-52f49314b73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:23.902580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 57/116] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:23.908046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170aca7-bf1a-4ef8-bf46-52f49314b73f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.915426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446a079-02b5-476f-8399-7de9cdac75d8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:23.964198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e5194-b9c3-4ac6-b896-790e5cef3d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:23.965261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5194-b9c3-4ac6-b896-790e5cef3d39 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:23.965543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5194-b9c3-4ac6-b896-790e5cef3d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:23.965817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5194-b9c3-4ac6-b896-790e5cef3d39 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:23.967579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e5194-b9c3-4ac6-b896-790e5cef3d39 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:23.969133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e5194-b9c3-4ac6-b896-790e5cef3d39 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:23.971156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 60/117] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:23.971745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e5194-b9c3-4ac6-b896-790e5cef3d39 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:23.994120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.042855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d170aca7-bf1a-4ef8-bf46-52f49314b73f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.069275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.085150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f3b26a-df4b-4029-a726-bfd8944e4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.086192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b26a-df4b-4029-a726-bfd8944e4e65 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.086483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b26a-df4b-4029-a726-bfd8944e4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.087042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f3b26a-df4b-4029-a726-bfd8944e4e65 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.088225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3b26a-df4b-4029-a726-bfd8944e4e65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.088812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3b26a-df4b-4029-a726-bfd8944e4e65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.090948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f3b26a-df4b-4029-a726-bfd8944e4e65 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.097223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e5194-b9c3-4ac6-b896-790e5cef3d39 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.100908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 58/118] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.102423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21ed3e-f354-4df7-8e92-f7fe4a63ddb0 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.102742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21ed3e-f354-4df7-8e92-f7fe4a63ddb0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.103024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21ed3e-f354-4df7-8e92-f7fe4a63ddb0 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.104406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 59/119] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:24.105012 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21ed3e-f354-4df7-8e92-f7fe4a63ddb0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.141021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215de8-7ab0-470f-8de3-3d5cdb23b872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.142152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215de8-7ab0-470f-8de3-3d5cdb23b872 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.142516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215de8-7ab0-470f-8de3-3d5cdb23b872 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.142897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90215de8-7ab0-470f-8de3-3d5cdb23b872 None admin] PATH_INFO: `/v3/users/bc7504a99e7249a395b2c1252117a52e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.144362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90215de8-7ab0-470f-8de3-3d5cdb23b872 None admin] RBAC: Authorizing `identity:get_user(user_id=bc7504a99e7249a395b2c1252117a52e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.146342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90215de8-7ab0-470f-8de3-3d5cdb23b872 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.148439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 61/120] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:23 2022] GET /identity/v3/users/bc7504a99e7249a395b2c1252117a52e => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.149419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215de8-7ab0-470f-8de3-3d5cdb23b872 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.235849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f21ed3e-f354-4df7-8e92-f7fe4a63ddb0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.242571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.268465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90215de8-7ab0-470f-8de3-3d5cdb23b872 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.277314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ce1fb-0079-4377-a63a-cb38ac248973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.278553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce1fb-0079-4377-a63a-cb38ac248973 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.279162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce1fb-0079-4377-a63a-cb38ac248973 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.279451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ce1fb-0079-4377-a63a-cb38ac248973 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.290767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ce1fb-0079-4377-a63a-cb38ac248973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-169ce1fb-0079-4377-a63a-cb38ac248973 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:24.299440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:24.300278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:24.301274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 60/121] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:24.301913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ce1fb-0079-4377-a63a-cb38ac248973 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.325462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fda3d-8664-4775-801f-1fc0d43b580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.326986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fda3d-8664-4775-801f-1fc0d43b580d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.328336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fda3d-8664-4775-801f-1fc0d43b580d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.328819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fda3d-8664-4775-801f-1fc0d43b580d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.331319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fda3d-8664-4775-801f-1fc0d43b580d None admin] RBAC: Adding query filter params (role.id=d2eaae75b1564805bb53d47f30537783, scope.project.id=3c571faec99847838c665f0fa1909346, user.id=aba76b5071ad45debc33032ede796ee3) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.332770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fda3d-8664-4775-801f-1fc0d43b580d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.335831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fda3d-8664-4775-801f-1fc0d43b580d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.345397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 62/122] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/role_assignments?user.id=aba76b5071ad45debc33032ede796ee3&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=d2eaae75b1564805bb53d47f30537783 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.348148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd32a-acf6-4ce3-93d8-132ecfe21d8e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.348624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd32a-acf6-4ce3-93d8-132ecfe21d8e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.349099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd32a-acf6-4ce3-93d8-132ecfe21d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.364644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.382677 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b3ffd32a-acf6-4ce3-93d8-132ecfe21d8e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:24.384000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b3ffd32a-acf6-4ce3-93d8-132ecfe21d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:24.438758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ce1fb-0079-4377-a63a-cb38ac248973 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.491279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 63/123] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:24.492310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd32a-acf6-4ce3-93d8-132ecfe21d8e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.492945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157ca07-1058-4f5c-af13-d65443251dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.494028 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ca07-1058-4f5c-af13-d65443251dbf None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.494481 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ca07-1058-4f5c-af13-d65443251dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.495306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ca07-1058-4f5c-af13-d65443251dbf None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.498312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157ca07-1058-4f5c-af13-d65443251dbf None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.500228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157ca07-1058-4f5c-af13-d65443251dbf None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.502133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 61/124] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.503846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157ca07-1058-4f5c-af13-d65443251dbf None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.606867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.657380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157ca07-1058-4f5c-af13-d65443251dbf None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.668235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd32a-acf6-4ce3-93d8-132ecfe21d8e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.675591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.704567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.705919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.706384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.706916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.708159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:24.708686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.710493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.710770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a140cf-9288-4c21-8eb6-fa97c6c9b96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.711957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a140cf-9288-4c21-8eb6-fa97c6c9b96c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.712244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a140cf-9288-4c21-8eb6-fa97c6c9b96c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.712569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a140cf-9288-4c21-8eb6-fa97c6c9b96c None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.714825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a140cf-9288-4c21-8eb6-fa97c6c9b96c None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.716302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a140cf-9288-4c21-8eb6-fa97c6c9b96c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.723797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 64/125] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.723797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a140cf-9288-4c21-8eb6-fa97c6c9b96c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.727091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 62/126] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.727810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.861014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb1c4d-95c3-4a93-88e4-8c4f995d41a5 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.863021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a140cf-9288-4c21-8eb6-fa97c6c9b96c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:24.903641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058985a5-4b97-4da2-98de-7aea792e9c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.905856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dcd1b-bf0c-40e1-a7f3-a7b1cf0dcd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:24.906315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dcd1b-bf0c-40e1-a7f3-a7b1cf0dcd7c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.906918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dcd1b-bf0c-40e1-a7f3-a7b1cf0dcd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.907214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dcd1b-bf0c-40e1-a7f3-a7b1cf0dcd7c None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.908024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058985a5-4b97-4da2-98de-7aea792e9c3a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:24.908467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5dcd1b-bf0c-40e1-a7f3-a7b1cf0dcd7c None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:24.908912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058985a5-4b97-4da2-98de-7aea792e9c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:24.909580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058985a5-4b97-4da2-98de-7aea792e9c3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:24.910259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5dcd1b-bf0c-40e1-a7f3-a7b1cf0dcd7c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:24.912441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 65/127] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:24.913653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dcd1b-bf0c-40e1-a7f3-a7b1cf0dcd7c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.924720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058985a5-4b97-4da2-98de-7aea792e9c3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:24.925462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-058985a5-4b97-4da2-98de-7aea792e9c3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:24.934444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:24.942773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:24.943562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 63/128] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:24.944845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058985a5-4b97-4da2-98de-7aea792e9c3a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:24.984690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.062311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dcd1b-bf0c-40e1-a7f3-a7b1cf0dcd7c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.073287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058985a5-4b97-4da2-98de-7aea792e9c3a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.109485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cec2-26b8-447e-83ed-2433b5a6390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.110718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cec2-26b8-447e-83ed-2433b5a6390b None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.111009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cec2-26b8-447e-83ed-2433b5a6390b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.111341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5cec2-26b8-447e-83ed-2433b5a6390b None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346/users/bc7504a99e7249a395b2c1252117a52e/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.114134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cec2-26b8-447e-83ed-2433b5a6390b None admin] RBAC: Authorizing `identity:create_grant(project_id=3c571faec99847838c665f0fa1909346, user_id=bc7504a99e7249a395b2c1252117a52e, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.116349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5cec2-26b8-447e-83ed-2433b5a6390b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.121320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9a9f4-d92f-4cc2-b933-3cf3de650faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.122744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9a9f4-d92f-4cc2-b933-3cf3de650faa None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.123019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9a9f4-d92f-4cc2-b933-3cf3de650faa None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.123362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9a9f4-d92f-4cc2-b933-3cf3de650faa None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.124945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9a9f4-d92f-4cc2-b933-3cf3de650faa None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.126789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9a9f4-d92f-4cc2-b933-3cf3de650faa None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.128789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 64/129] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:24 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.133192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9a9f4-d92f-4cc2-b933-3cf3de650faa None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.176718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 66/130] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:24 2022] PUT /identity/v3/projects/3c571faec99847838c665f0fa1909346/users/bc7504a99e7249a395b2c1252117a52e/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:25.178226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cec2-26b8-447e-83ed-2433b5a6390b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.324232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9a9f4-d92f-4cc2-b933-3cf3de650faa None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.327488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.369843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.394021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d04ab7-2cd8-4d2a-9edc-3b9b5126a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.395421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04ab7-2cd8-4d2a-9edc-3b9b5126a329 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.395892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04ab7-2cd8-4d2a-9edc-3b9b5126a329 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.396353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d04ab7-2cd8-4d2a-9edc-3b9b5126a329 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346/users/839d126470c7460e8379a9881d54b5ce/roles/af8d06df2b8647859f2fe7b60e0da912` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.399063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d04ab7-2cd8-4d2a-9edc-3b9b5126a329 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c571faec99847838c665f0fa1909346, user_id=839d126470c7460e8379a9881d54b5ce, role_id=af8d06df2b8647859f2fe7b60e0da912)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.401175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d04ab7-2cd8-4d2a-9edc-3b9b5126a329 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.434795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5cec2-26b8-447e-83ed-2433b5a6390b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.478630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.479669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.480227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.480702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.481736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:25.482799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.484443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.494852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 67/131] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.496164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.508964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 65/132] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:25 2022] PUT /identity/v3/projects/3c571faec99847838c665f0fa1909346/users/839d126470c7460e8379a9881d54b5ce/roles/af8d06df2b8647859f2fe7b60e0da912 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:25.510490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d04ab7-2cd8-4d2a-9edc-3b9b5126a329 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.745645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d04ab7-2cd8-4d2a-9edc-3b9b5126a329 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.773088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83673d54-d3a2-4345-b9d1-32160f65c818 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:25.817900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ce6b-9f3a-41fe-a181-711c317ef18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.818824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ce6b-9f3a-41fe-a181-711c317ef18f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.819107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ce6b-9f3a-41fe-a181-711c317ef18f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.819385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7ce6b-9f3a-41fe-a181-711c317ef18f None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.821832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7ce6b-9f3a-41fe-a181-711c317ef18f None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.823368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7ce6b-9f3a-41fe-a181-711c317ef18f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.826812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 66/133] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.832510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ce6b-9f3a-41fe-a181-711c317ef18f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.834975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.853664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836560c-7be3-4dac-b9a0-a20e7a633782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:25.854623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836560c-7be3-4dac-b9a0-a20e7a633782 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:25.854871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836560c-7be3-4dac-b9a0-a20e7a633782 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:25.855154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836560c-7be3-4dac-b9a0-a20e7a633782 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:25.858278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836560c-7be3-4dac-b9a0-a20e7a633782 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:25.859795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836560c-7be3-4dac-b9a0-a20e7a633782 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:25.861770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 68/134] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:25.867501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836560c-7be3-4dac-b9a0-a20e7a633782 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:25.887355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:25.976089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7ce6b-9f3a-41fe-a181-711c317ef18f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.022413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60f9d-6875-4f88-b84b-190209362a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.023731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60f9d-6875-4f88-b84b-190209362a6f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.025251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60f9d-6875-4f88-b84b-190209362a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.026381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60f9d-6875-4f88-b84b-190209362a6f None admin] PATH_INFO: `/v3/projects/edc7d0c845b94817a1f39e8b90989f48` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.028053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd60f9d-6875-4f88-b84b-190209362a6f None admin] RBAC: Authorizing `identity:get_project(project_id=edc7d0c845b94817a1f39e8b90989f48)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.031044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd60f9d-6875-4f88-b84b-190209362a6f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.039490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 67/135] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:25 2022] GET /identity/v3/projects/edc7d0c845b94817a1f39e8b90989f48 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:26.045692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60f9d-6875-4f88-b84b-190209362a6f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.108381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836560c-7be3-4dac-b9a0-a20e7a633782 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.179656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.185086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60f9d-6875-4f88-b84b-190209362a6f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.194774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625214c-133e-4e28-9b0d-5a0de8220969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.196342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625214c-133e-4e28-9b0d-5a0de8220969 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.196342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625214c-133e-4e28-9b0d-5a0de8220969 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.196342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625214c-133e-4e28-9b0d-5a0de8220969 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346/users/839d126470c7460e8379a9881d54b5ce/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.204085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625214c-133e-4e28-9b0d-5a0de8220969 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c571faec99847838c665f0fa1909346, user_id=839d126470c7460e8379a9881d54b5ce, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.205649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625214c-133e-4e28-9b0d-5a0de8220969 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.230233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d4a6e-f4f4-449b-8a39-f0be0d4ea0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.231416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4a6e-f4f4-449b-8a39-f0be0d4ea0db None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.231834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4a6e-f4f4-449b-8a39-f0be0d4ea0db None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.232305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d4a6e-f4f4-449b-8a39-f0be0d4ea0db None admin] PATH_INFO: `/v3/projects/edc7d0c845b94817a1f39e8b90989f48/users/839d126470c7460e8379a9881d54b5ce/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.239419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d4a6e-f4f4-449b-8a39-f0be0d4ea0db None admin] RBAC: Authorizing `identity:create_grant(project_id=edc7d0c845b94817a1f39e8b90989f48, user_id=839d126470c7460e8379a9881d54b5ce, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.241198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2d4a6e-f4f4-449b-8a39-f0be0d4ea0db None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.300921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 69/136] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:25 2022] PUT /identity/v3/projects/3c571faec99847838c665f0fa1909346/users/839d126470c7460e8379a9881d54b5ce/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:26.321149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 68/137] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:26 2022] PUT /identity/v3/projects/edc7d0c845b94817a1f39e8b90989f48/users/839d126470c7460e8379a9881d54b5ce/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:24:26.400457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16361a-e4a5-4eab-b019-04f0883d8176 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.400747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16361a-e4a5-4eab-b019-04f0883d8176 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.401089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16361a-e4a5-4eab-b019-04f0883d8176 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.402546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 70/138] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:26.415915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8576f-de10-40d3-a96a-4182592536ad None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.416465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8576f-de10-40d3-a96a-4182592536ad None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.416932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8576f-de10-40d3-a96a-4182592536ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.438991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-00e8576f-de10-40d3-a96a-4182592536ad None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:26.440588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-00e8576f-de10-40d3-a96a-4182592536ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:26.549790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 69/139] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:26.589772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16361a-e4a5-4eab-b019-04f0883d8176 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.664146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.715625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16361a-e4a5-4eab-b019-04f0883d8176 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.757760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b15b1-1b3e-441a-9b2a-87bf369d5ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.758604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b15b1-1b3e-441a-9b2a-87bf369d5ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.758898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b15b1-1b3e-441a-9b2a-87bf369d5ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.759180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b15b1-1b3e-441a-9b2a-87bf369d5ae2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.760426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b15b1-1b3e-441a-9b2a-87bf369d5ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.761902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b15b1-1b3e-441a-9b2a-87bf369d5ae2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:26.764092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 71/140] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:26.769809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8576f-de10-40d3-a96a-4182592536ad None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:26.910259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:26.929675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8576f-de10-40d3-a96a-4182592536ad None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:26.976164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6269b4-5c10-4b70-b889-02784990cf10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:26.976868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6269b4-5c10-4b70-b889-02784990cf10 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:26.977158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6269b4-5c10-4b70-b889-02784990cf10 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:26.977438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6269b4-5c10-4b70-b889-02784990cf10 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:26.978191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6269b4-5c10-4b70-b889-02784990cf10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:26.979723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6269b4-5c10-4b70-b889-02784990cf10 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.085570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 70/141] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:24:26 2022] POST /identity/v3/users => generated 283 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:24:27.237987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f1f5-19f9-4a22-a879-4eabac89516e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.238490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f1f5-19f9-4a22-a879-4eabac89516e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.238490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10f1f5-19f9-4a22-a879-4eabac89516e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.240091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 72/142] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:27.245676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193781-bdad-483d-93b0-1600cf05ad4f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.246155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193781-bdad-483d-93b0-1600cf05ad4f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.246228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8193781-bdad-483d-93b0-1600cf05ad4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.271610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b8193781-bdad-483d-93b0-1600cf05ad4f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:27.272855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b8193781-bdad-483d-93b0-1600cf05ad4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:27.376966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 71/143] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:27.413399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10f1f5-19f9-4a22-a879-4eabac89516e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.556553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10f1f5-19f9-4a22-a879-4eabac89516e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.589667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.605412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3ce3c-243f-4518-8088-c5eac5dee9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.606602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ce3c-243f-4518-8088-c5eac5dee9ae None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.607119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ce3c-243f-4518-8088-c5eac5dee9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.607747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3ce3c-243f-4518-8088-c5eac5dee9ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.623722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3ce3c-243f-4518-8088-c5eac5dee9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-36a3ce3c-243f-4518-8088-c5eac5dee9ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:27.631943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:27.632817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:27.633557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:27.636013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 73/144] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:27.642787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8193781-bdad-483d-93b0-1600cf05ad4f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:27.761113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:27.798809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8193781-bdad-483d-93b0-1600cf05ad4f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:27.849954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:27.850570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:27.850864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:27.851156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:27.851909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:27.852213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:27.853601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:27.865939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 72/145] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:27.871563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3ce3c-243f-4518-8088-c5eac5dee9ae None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.023211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3ce3c-243f-4518-8088-c5eac5dee9ae None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.074610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3221e3-6296-4ac5-9015-11ed4a1cc861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.076395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3221e3-6296-4ac5-9015-11ed4a1cc861 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.077098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3221e3-6296-4ac5-9015-11ed4a1cc861 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.077575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3221e3-6296-4ac5-9015-11ed4a1cc861 None admin] PATH_INFO: `/v3/users/aba76b5071ad45debc33032ede796ee3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.083375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3221e3-6296-4ac5-9015-11ed4a1cc861 None admin] RBAC: Authorizing `identity:get_user(user_id=aba76b5071ad45debc33032ede796ee3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.085149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3221e3-6296-4ac5-9015-11ed4a1cc861 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.087363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 74/146] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:27 2022] GET /identity/v3/users/aba76b5071ad45debc33032ede796ee3 => generated 289 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:28.093842 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.241322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2ad4a-516b-4aee-b218-de713ad217f4 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.292226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ab1cbf-9084-4f81-80f1-a036fd1b354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.293105 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab1cbf-9084-4f81-80f1-a036fd1b354b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.293388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab1cbf-9084-4f81-80f1-a036fd1b354b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.293665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ab1cbf-9084-4f81-80f1-a036fd1b354b None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.295116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab1cbf-9084-4f81-80f1-a036fd1b354b None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.296647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ab1cbf-9084-4f81-80f1-a036fd1b354b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.298566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 73/147] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:28.304110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3221e3-6296-4ac5-9015-11ed4a1cc861 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.386595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:28.449605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3221e3-6296-4ac5-9015-11ed4a1cc861 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:28.498414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b00a2-4fbd-4d30-ad8f-9378127caad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:28.499691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b00a2-4fbd-4d30-ad8f-9378127caad1 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.500206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b00a2-4fbd-4d30-ad8f-9378127caad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.500711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b00a2-4fbd-4d30-ad8f-9378127caad1 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346/users/aba76b5071ad45debc33032ede796ee3/roles/d2eaae75b1564805bb53d47f30537783` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.504037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b00a2-4fbd-4d30-ad8f-9378127caad1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c571faec99847838c665f0fa1909346, user_id=aba76b5071ad45debc33032ede796ee3, role_id=d2eaae75b1564805bb53d47f30537783)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:28.505534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b00a2-4fbd-4d30-ad8f-9378127caad1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:28.565730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 75/148] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:28 2022] PUT /identity/v3/projects/3c571faec99847838c665f0fa1909346/users/aba76b5071ad45debc33032ede796ee3/roles/d2eaae75b1564805bb53d47f30537783 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:28.741415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec34f0-73c2-461f-b4e8-18945e932810 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.741748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec34f0-73c2-461f-b4e8-18945e932810 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.741985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec34f0-73c2-461f-b4e8-18945e932810 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.743404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 74/149] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:28.749640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d500-1eec-4014-8542-054628088b91 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:28.749896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d500-1eec-4014-8542-054628088b91 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:28.750126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d711d500-1eec-4014-8542-054628088b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:28.775741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d711d500-1eec-4014-8542-054628088b91 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:28.776977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d711d500-1eec-4014-8542-054628088b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:28.865023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 76/150] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:28.907015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec34f0-73c2-461f-b4e8-18945e932810 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:28.913733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.040374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec34f0-73c2-461f-b4e8-18945e932810 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.080097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2382de-7abe-4722-8793-8f4f799b5071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.080910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2382de-7abe-4722-8793-8f4f799b5071 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.081251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2382de-7abe-4722-8793-8f4f799b5071 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.081570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2382de-7abe-4722-8793-8f4f799b5071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.097191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2382de-7abe-4722-8793-8f4f799b5071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-0d2382de-7abe-4722-8793-8f4f799b5071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:29.104952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:29.105763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:29.106586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 75/151] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:29.113122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711d500-1eec-4014-8542-054628088b91 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.179129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.262678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d711d500-1eec-4014-8542-054628088b91 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.313605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215fd2-d17c-45d9-aced-f233c98bebd6 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.314227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215fd2-d17c-45d9-aced-f233c98bebd6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.314227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba215fd2-d17c-45d9-aced-f233c98bebd6 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.315532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 76/152] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:29.321212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fc374-6fd0-41d8-9963-58e61f620787 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.321603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fc374-6fd0-41d8-9963-58e61f620787 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.321884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fc374-6fd0-41d8-9963-58e61f620787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.336526 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.337366 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.337656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.338088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.338963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:29.339399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.342158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.347926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b71fc374-6fd0-41d8-9963-58e61f620787 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:29.349166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b71fc374-6fd0-41d8-9963-58e61f620787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:29.358671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 77/153] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:29.363873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.481020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.497853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 77/154] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:29.542792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fc374-6fd0-41d8-9963-58e61f620787 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.589215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa499b-4a6a-4587-91a7-74c0f6e6ae35 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.596007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:29.651599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a874bf4-846a-4aea-89b4-7932baceb9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.652734 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a874bf4-846a-4aea-89b4-7932baceb9df None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.653189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a874bf4-846a-4aea-89b4-7932baceb9df None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.653633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a874bf4-846a-4aea-89b4-7932baceb9df None admin] PATH_INFO: `/v3/users/bc7504a99e7249a395b2c1252117a52e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.655259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a874bf4-846a-4aea-89b4-7932baceb9df None admin] RBAC: Authorizing `identity:get_user(user_id=bc7504a99e7249a395b2c1252117a52e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:29.657360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a874bf4-846a-4aea-89b4-7932baceb9df None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:29.663853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 78/155] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/users/bc7504a99e7249a395b2c1252117a52e => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:29.672404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a874bf4-846a-4aea-89b4-7932baceb9df None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.755398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fc374-6fd0-41d8-9963-58e61f620787 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:29.837495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61590-5c62-4d2b-b7f5-ea286ea14755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:29.838329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61590-5c62-4d2b-b7f5-ea286ea14755 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:29.838641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61590-5c62-4d2b-b7f5-ea286ea14755 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:29.838920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c61590-5c62-4d2b-b7f5-ea286ea14755 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:29.862584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c61590-5c62-4d2b-b7f5-ea286ea14755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-63c61590-5c62-4d2b-b7f5-ea286ea14755 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:29.871033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:29.871920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:29.873393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:29.874749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 78/156] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:29.883762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61590-5c62-4d2b-b7f5-ea286ea14755 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:29.954670 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a874bf4-846a-4aea-89b4-7932baceb9df None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.001793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.057959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7721a15-1e75-4737-ba7e-2b2d2af5f018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.058646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7721a15-1e75-4737-ba7e-2b2d2af5f018 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.058923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7721a15-1e75-4737-ba7e-2b2d2af5f018 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.059195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7721a15-1e75-4737-ba7e-2b2d2af5f018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.132640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c61590-5c62-4d2b-b7f5-ea286ea14755 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.164423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.215854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.216611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.216888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.217160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.217919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.218221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.219769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.220960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7721a15-1e75-4737-ba7e-2b2d2af5f018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.222486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7721a15-1e75-4737-ba7e-2b2d2af5f018 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.234323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 79/157] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:30.239850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.400095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135bef4-c4b2-463e-904f-b64cdd8f158c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.402989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 79/158] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:30.421640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7721a15-1e75-4737-ba7e-2b2d2af5f018 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.437568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.464201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965570-b190-430a-a2f4-d0493ff41e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.465099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965570-b190-430a-a2f4-d0493ff41e55 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.465374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965570-b190-430a-a2f4-d0493ff41e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.465648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64965570-b190-430a-a2f4-d0493ff41e55 None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.467719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965570-b190-430a-a2f4-d0493ff41e55 None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.469163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64965570-b190-430a-a2f4-d0493ff41e55 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.470847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 80/159] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:30.476221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965570-b190-430a-a2f4-d0493ff41e55 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.530668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.571260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7721a15-1e75-4737-ba7e-2b2d2af5f018 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.609879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a86b32-2d51-4a15-adbd-95752c2a6a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.610813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86b32-2d51-4a15-adbd-95752c2a6a15 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.611100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86b32-2d51-4a15-adbd-95752c2a6a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.611372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86b32-2d51-4a15-adbd-95752c2a6a15 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.614560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86b32-2d51-4a15-adbd-95752c2a6a15 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.616044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a86b32-2d51-4a15-adbd-95752c2a6a15 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.619956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 80/160] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.625792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d718c5-1e09-4e52-9e60-bf0e54224b0d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.626087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d718c5-1e09-4e52-9e60-bf0e54224b0d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.626350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d718c5-1e09-4e52-9e60-bf0e54224b0d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.627976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 81/161] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:30.628553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d718c5-1e09-4e52-9e60-bf0e54224b0d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:30.653183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64965570-b190-430a-a2f4-d0493ff41e55 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.732137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2560e7c-bfb0-4129-9a3c-04ad1dbc33a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.732821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2560e7c-bfb0-4129-9a3c-04ad1dbc33a2 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.733102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2560e7c-bfb0-4129-9a3c-04ad1dbc33a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.733375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2560e7c-bfb0-4129-9a3c-04ad1dbc33a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.846980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:30.866482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2560e7c-bfb0-4129-9a3c-04ad1dbc33a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.868295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2560e7c-bfb0-4129-9a3c-04ad1dbc33a2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.874498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d718c5-1e09-4e52-9e60-bf0e54224b0d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:30.955373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9c122-fb8f-43d5-afcf-79ea62dd51db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:30.955968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9c122-fb8f-43d5-afcf-79ea62dd51db None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.956247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9c122-fb8f-43d5-afcf-79ea62dd51db None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.956516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9c122-fb8f-43d5-afcf-79ea62dd51db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.957371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9c122-fb8f-43d5-afcf-79ea62dd51db None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=3c571faec99847838c665f0fa1909346, user.id=bc7504a99e7249a395b2c1252117a52e) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:30.957679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9c122-fb8f-43d5-afcf-79ea62dd51db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:30.961615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd9c122-fb8f-43d5-afcf-79ea62dd51db None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:30.977122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 82/162] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/role_assignments?user.id=bc7504a99e7249a395b2c1252117a52e&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=07de3e1931ca4d799df8510428e181aa => generated 608 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:30.978197 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57be4-bb0f-42bb-9863-afc1048fb2f2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:30.979882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57be4-bb0f-42bb-9863-afc1048fb2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:30.980289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e57be4-bb0f-42bb-9863-afc1048fb2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:30.987890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.001600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a4e57be4-bb0f-42bb-9863-afc1048fb2f2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:31.003105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a4e57be4-bb0f-42bb-9863-afc1048fb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:31.086555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 83/163] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:31.086555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eef89-1c66-4846-b3f5-964d28f56690 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.086555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eef89-1c66-4846-b3f5-964d28f56690 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.086555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572eef89-1c66-4846-b3f5-964d28f56690 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.086555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 84/164] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:31.089319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 81/165] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 613 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:31.094809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eef89-1c66-4846-b3f5-964d28f56690 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.099279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e430-682f-49d7-b856-104eb3f14b88 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.099638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e430-682f-49d7-b856-104eb3f14b88 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.099984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4e430-682f-49d7-b856-104eb3f14b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.134342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-0db4e430-682f-49d7-b856-104eb3f14b88 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:31.135623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0db4e430-682f-49d7-b856-104eb3f14b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:31.301662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 82/166] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:31.302551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4e430-682f-49d7-b856-104eb3f14b88 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.321195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572eef89-1c66-4846-b3f5-964d28f56690 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.379781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.451975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfdcc7-6f27-425e-b532-c170e5e287ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.453312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfdcc7-6f27-425e-b532-c170e5e287ce None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.453730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfdcc7-6f27-425e-b532-c170e5e287ce None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.454142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cfdcc7-6f27-425e-b532-c170e5e287ce None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.456665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfdcc7-6f27-425e-b532-c170e5e287ce None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:31.459031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cfdcc7-6f27-425e-b532-c170e5e287ce None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:31.461941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 85/167] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:31.463180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfdcc7-6f27-425e-b532-c170e5e287ce None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.466622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.574002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4e430-682f-49d7-b856-104eb3f14b88 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.635277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdac17-6100-49f8-8537-c8cb48bf2ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.636104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdac17-6100-49f8-8537-c8cb48bf2ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.636382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdac17-6100-49f8-8537-c8cb48bf2ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.636651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdac17-6100-49f8-8537-c8cb48bf2ce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.658004 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdac17-6100-49f8-8537-c8cb48bf2ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:31.661809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cfdcc7-6f27-425e-b532-c170e5e287ce None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-91bdac17-6100-49f8-8537-c8cb48bf2ce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:31.666506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.667597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:31.668356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 83/168] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:31.669581 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdac17-6100-49f8-8537-c8cb48bf2ce2 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.731875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5956-635b-4e52-a306-d225e1765d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:31.732925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5956-635b-4e52-a306-d225e1765d53 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:31.733199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5956-635b-4e52-a306-d225e1765d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:31.733480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5e5956-635b-4e52-a306-d225e1765d53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:31.748260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5e5956-635b-4e52-a306-d225e1765d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8b5e5956-635b-4e52-a306-d225e1765d53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:31.765363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:31.766381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:31.767217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 86/169] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:31.767858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5956-635b-4e52-a306-d225e1765d53 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:31.862146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.894644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:31.937112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdac17-6100-49f8-8537-c8cb48bf2ce2 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:31.995965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5e5956-635b-4e52-a306-d225e1765d53 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.029715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.030391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.030702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.030996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.031834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] RBAC: Adding query filter params (role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=3c571faec99847838c665f0fa1909346, user.id=839d126470c7460e8379a9881d54b5ce) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:32.032150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.033619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.049257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 84/170] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/role_assignments?user.id=839d126470c7460e8379a9881d54b5ce&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 608 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.050562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.104376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.105073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.105362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.105639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.106552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:32.106875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.108304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.126406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 87/171] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.133936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.239613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb21b56-618c-4234-a87e-4f7829ef5f9b None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.304877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3cc5db-f11b-4dcb-9b0b-135b8c416f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.307171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc5db-f11b-4dcb-9b0b-135b8c416f1b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.308056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc5db-f11b-4dcb-9b0b-135b8c416f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.311070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3cc5db-f11b-4dcb-9b0b-135b8c416f1b None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.312226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cc5db-f11b-4dcb-9b0b-135b8c416f1b None admin] RBAC: Adding query filter params (name=member) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:32.312750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cc5db-f11b-4dcb-9b0b-135b8c416f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.319494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3cc5db-f11b-4dcb-9b0b-135b8c416f1b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.333206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.341185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 85/172] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.344849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70e1d-818f-42a1-9ee8-3114a180f0e9 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.346821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70e1d-818f-42a1-9ee8-3114a180f0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.348979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f70e1d-818f-42a1-9ee8-3114a180f0e9 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.350660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 86/173] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:32.352157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f70e1d-818f-42a1-9ee8-3114a180f0e9 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.410436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebb2f4-8feb-47cf-a678-bcfa05b24bb9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.469951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.500736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e53282-0aa4-4c05-a70f-842ee3c2b65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.501700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e53282-0aa4-4c05-a70f-842ee3c2b65b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.501982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e53282-0aa4-4c05-a70f-842ee3c2b65b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.502338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e53282-0aa4-4c05-a70f-842ee3c2b65b None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.503694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e53282-0aa4-4c05-a70f-842ee3c2b65b None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.505192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e53282-0aa4-4c05-a70f-842ee3c2b65b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.511725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 88/174] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:32.513759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2f63-b5a7-4245-a5bf-fe9155b71d21 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.514142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2f63-b5a7-4245-a5bf-fe9155b71d21 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.514427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee2f63-b5a7-4245-a5bf-fe9155b71d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.549176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-67ee2f63-b5a7-4245-a5bf-fe9155b71d21 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:32.550401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-67ee2f63-b5a7-4245-a5bf-fe9155b71d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:32.581434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f70e1d-818f-42a1-9ee8-3114a180f0e9 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.619915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ad672-d927-4a32-9a47-d562d7543ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.620796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ad672-d927-4a32-9a47-d562d7543ca8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.621073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ad672-d927-4a32-9a47-d562d7543ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.621346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ad672-d927-4a32-9a47-d562d7543ca8 None admin] PATH_INFO: `/v3/users/839d126470c7460e8379a9881d54b5ce` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.624003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ad672-d927-4a32-9a47-d562d7543ca8 None admin] RBAC: Authorizing `identity:get_user(user_id=839d126470c7460e8379a9881d54b5ce)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.625553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ad672-d927-4a32-9a47-d562d7543ca8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.627523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 87/175] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/users/839d126470c7460e8379a9881d54b5ce => generated 275 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:32.628387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ad672-d927-4a32-9a47-d562d7543ca8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.667145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 89/176] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:32.668564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dec33-92f3-4eca-baf4-93ca6947d4fb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.668965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dec33-92f3-4eca-baf4-93ca6947d4fb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.669470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11dec33-92f3-4eca-baf4-93ca6947d4fb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.671111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 90/177] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:32.671951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dec33-92f3-4eca-baf4-93ca6947d4fb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:32.719089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.764243 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ad672-d927-4a32-9a47-d562d7543ca8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.816432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c8de4-e56e-461e-8841-4fc9516ace99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.817111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8de4-e56e-461e-8841-4fc9516ace99 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.817391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8de4-e56e-461e-8841-4fc9516ace99 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.817666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8de4-e56e-461e-8841-4fc9516ace99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.837559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11dec33-92f3-4eca-baf4-93ca6947d4fb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:32.865837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:32.884122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678707a0-f3de-4538-ba2a-282e4334faea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:32.884799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678707a0-f3de-4538-ba2a-282e4334faea None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:32.885078 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678707a0-f3de-4538-ba2a-282e4334faea None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:32.885470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678707a0-f3de-4538-ba2a-282e4334faea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:32.928082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c8de4-e56e-461e-8841-4fc9516ace99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.932155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c8de4-e56e-461e-8841-4fc9516ace99 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:32.992054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678707a0-f3de-4538-ba2a-282e4334faea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:32.993750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678707a0-f3de-4538-ba2a-282e4334faea None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.040973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.085301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 88/178] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:33.087096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb8ba4-0183-46aa-a41a-7f231e87b307 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.087383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb8ba4-0183-46aa-a41a-7f231e87b307 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.087663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb8ba4-0183-46aa-a41a-7f231e87b307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.108801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-addb8ba4-0183-46aa-a41a-7f231e87b307 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:33.110825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-addb8ba4-0183-46aa-a41a-7f231e87b307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:33.136753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 91/179] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:33.138216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678707a0-f3de-4538-ba2a-282e4334faea None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.172225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.209978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 89/180] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:33.212249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b255cac-64c3-4670-9eaa-1dc8eeb4d49d None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.212835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b255cac-64c3-4670-9eaa-1dc8eeb4d49d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.213167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b255cac-64c3-4670-9eaa-1dc8eeb4d49d None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.215839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 90/181] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:33.219763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b255cac-64c3-4670-9eaa-1dc8eeb4d49d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.283432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678707a0-f3de-4538-ba2a-282e4334faea None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.326086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855359e-e69f-4ae0-8e11-3a5708efc271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.326934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855359e-e69f-4ae0-8e11-3a5708efc271 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.327221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855359e-e69f-4ae0-8e11-3a5708efc271 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.327499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855359e-e69f-4ae0-8e11-3a5708efc271 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.342867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855359e-e69f-4ae0-8e11-3a5708efc271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:33.349939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c855359e-e69f-4ae0-8e11-3a5708efc271 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:33.350933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:33.352603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:33.353824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 92/182] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:33.355129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97ef4-12f6-4b03-93ed-5475110ff6c1 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.355416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97ef4-12f6-4b03-93ed-5475110ff6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.355694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97ef4-12f6-4b03-93ed-5475110ff6c1 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.357817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 93/183] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:33.358430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad97ef4-12f6-4b03-93ed-5475110ff6c1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.364665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b255cac-64c3-4670-9eaa-1dc8eeb4d49d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.402057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400db470-e597-49e9-bf40-32a43056d42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.403718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db470-e597-49e9-bf40-32a43056d42c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.404005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db470-e597-49e9-bf40-32a43056d42c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.404275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db470-e597-49e9-bf40-32a43056d42c None admin] PATH_INFO: `/v3/projects/edc7d0c845b94817a1f39e8b90989f48` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.405478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400db470-e597-49e9-bf40-32a43056d42c None admin] RBAC: Authorizing `identity:get_project(project_id=edc7d0c845b94817a1f39e8b90989f48)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.406963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400db470-e597-49e9-bf40-32a43056d42c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.408677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 91/184] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/projects/edc7d0c845b94817a1f39e8b90989f48 => generated 312 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:33.409882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12409a-20e4-4ae0-b1bc-57271a6e3b44 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.410171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12409a-20e4-4ae0-b1bc-57271a6e3b44 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.410445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12409a-20e4-4ae0-b1bc-57271a6e3b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.427891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ba12409a-20e4-4ae0-b1bc-57271a6e3b44 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:33.429076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ba12409a-20e4-4ae0-b1bc-57271a6e3b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:33.460955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.479867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad97ef4-12f6-4b03-93ed-5475110ff6c1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.518415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83819b1-cc08-4969-bf26-3d0b38f2dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.519806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83819b1-cc08-4969-bf26-3d0b38f2dd72 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.520274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83819b1-cc08-4969-bf26-3d0b38f2dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.520720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83819b1-cc08-4969-bf26-3d0b38f2dd72 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.522634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83819b1-cc08-4969-bf26-3d0b38f2dd72 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.524562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 92/185] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:33.525157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12409a-20e4-4ae0-b1bc-57271a6e3b44 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.525386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83819b1-cc08-4969-bf26-3d0b38f2dd72 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.529185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 94/186] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:33.530251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83819b1-cc08-4969-bf26-3d0b38f2dd72 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.628639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.634098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12409a-20e4-4ae0-b1bc-57271a6e3b44 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.661777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83819b1-cc08-4969-bf26-3d0b38f2dd72 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.669731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0c67b9-6683-4ceb-bd24-1428e30c97b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.670568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c67b9-6683-4ceb-bd24-1428e30c97b0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.670955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c67b9-6683-4ceb-bd24-1428e30c97b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.671447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0c67b9-6683-4ceb-bd24-1428e30c97b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.684779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0c67b9-6683-4ceb-bd24-1428e30c97b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-5a0c67b9-6683-4ceb-bd24-1428e30c97b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:33.693654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:33.694698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:33.695804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 93/187] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:33.696832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d5ca-ae15-48f7-90ea-68d2792818d5 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.696832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d5ca-ae15-48f7-90ea-68d2792818d5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.696832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d5ca-ae15-48f7-90ea-68d2792818d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.708374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.709049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.709330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.709604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.710360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:33.710700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.712147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.714394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-d1d5d5ca-ae15-48f7-90ea-68d2792818d5 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:33.716334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d1d5d5ca-ae15-48f7-90ea-68d2792818d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:33.721718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 95/188] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:33.722379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.741841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.789214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 94/189] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:33.790066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d5ca-ae15-48f7-90ea-68d2792818d5 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.845104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230a4f-1295-4d47-badf-4f2e8add3afb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.878996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:33.881153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.881817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.882097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.882371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.883254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] RBAC: Adding query filter params (role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=edc7d0c845b94817a1f39e8b90989f48, user.id=839d126470c7460e8379a9881d54b5ce) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:33.883566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.885047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.891423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 96/190] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/role_assignments?user.id=839d126470c7460e8379a9881d54b5ce&scope.project.id=edc7d0c845b94817a1f39e8b90989f48&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:33.892261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.894889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d5ca-ae15-48f7-90ea-68d2792818d5 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:33.940021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:33.941069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:33.941361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:33.941637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:33.942852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] RBAC: Adding query filter params (role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=3c571faec99847838c665f0fa1909346, user.id=839d126470c7460e8379a9881d54b5ce) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:33.943451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:33.945140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:33.962827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 95/191] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/role_assignments?user.id=839d126470c7460e8379a9881d54b5ce&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:33.962827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:33.984378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.013348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed8174-885a-4d5b-b6b5-aed0bb9fafc0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.063013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a1f6-2aeb-4b31-8a5b-18971a68ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.064285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a1f6-2aeb-4b31-8a5b-18971a68ffae None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.064645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a1f6-2aeb-4b31-8a5b-18971a68ffae None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.065018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994a1f6-2aeb-4b31-8a5b-18971a68ffae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.066559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994a1f6-2aeb-4b31-8a5b-18971a68ffae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.068196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5994a1f6-2aeb-4b31-8a5b-18971a68ffae None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.070417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 97/192] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.071359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a1f6-2aeb-4b31-8a5b-18971a68ffae None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.111375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9221a-52eb-4951-b498-db100cd33ed6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.165873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.167599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.168133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.168794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.169795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:34.170300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.173513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.185256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 96/193] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:24:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.186351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.210930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.229855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994a1f6-2aeb-4b31-8a5b-18971a68ffae None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.277082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c9e9-460f-4f0f-a79e-12a7ce7fc9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.277082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c9e9-460f-4f0f-a79e-12a7ce7fc9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.277339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c9e9-460f-4f0f-a79e-12a7ce7fc9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.278659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c9e9-460f-4f0f-a79e-12a7ce7fc9c4 None admin] PATH_INFO: `/v3/users/bc517f7fc5664949a2821d701a44a233` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.294133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c9e9-460f-4f0f-a79e-12a7ce7fc9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=bc517f7fc5664949a2821d701a44a233)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.296118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c9e9-460f-4f0f-a79e-12a7ce7fc9c4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.297898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 98/194] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/users/bc517f7fc5664949a2821d701a44a233 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.298702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c9e9-460f-4f0f-a79e-12a7ce7fc9c4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.301459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.314923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec0f4d-2d2d-4e99-b5cf-adbd35bfc864 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.383924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97601827-8a3e-480f-b801-ade63a1ca33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.384729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601827-8a3e-480f-b801-ade63a1ca33c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.385010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601827-8a3e-480f-b801-ade63a1ca33c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.385283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97601827-8a3e-480f-b801-ade63a1ca33c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.396339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97601827-8a3e-480f-b801-ade63a1ca33c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-97601827-8a3e-480f-b801-ade63a1ca33c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:34.405066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:34.405970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:34.406783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 97/195] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:34.407439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97601827-8a3e-480f-b801-ade63a1ca33c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.421858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c9e9-460f-4f0f-a79e-12a7ce7fc9c4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.458072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f22323-d360-4487-bb64-fef60102fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.458782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f22323-d360-4487-bb64-fef60102fc0f None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.459066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f22323-d360-4487-bb64-fef60102fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.459340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f22323-d360-4487-bb64-fef60102fc0f None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f22323-d360-4487-bb64-fef60102fc0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.461489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f22323-d360-4487-bb64-fef60102fc0f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.487068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.518984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97601827-8a3e-480f-b801-ade63a1ca33c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.555522 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941d939-1c18-49ff-9d58-ed395dc12bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.556453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941d939-1c18-49ff-9d58-ed395dc12bbe None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.556748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941d939-1c18-49ff-9d58-ed395dc12bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.557037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941d939-1c18-49ff-9d58-ed395dc12bbe None admin] PATH_INFO: `/v3/users/bc517f7fc5664949a2821d701a44a233` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.560515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941d939-1c18-49ff-9d58-ed395dc12bbe None admin] RBAC: Authorizing `identity:get_user(user_id=bc517f7fc5664949a2821d701a44a233)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.561295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 99/196] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:24:34 2022] POST /identity/v3/users => generated 297 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:34.562213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f22323-d360-4487-bb64-fef60102fc0f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.563293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941d939-1c18-49ff-9d58-ed395dc12bbe None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.566500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 98/197] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/users/bc517f7fc5664949a2821d701a44a233 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.569017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941d939-1c18-49ff-9d58-ed395dc12bbe None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.656600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.719181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941d939-1c18-49ff-9d58-ed395dc12bbe None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.731784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f22323-d360-4487-bb64-fef60102fc0f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.763090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.764115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.764394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.764662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.765417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:34.765723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.767155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.771701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a93d8-2399-49fa-9c63-84c1efbd06a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.772360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a93d8-2399-49fa-9c63-84c1efbd06a6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.772645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a93d8-2399-49fa-9c63-84c1efbd06a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.772921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a93d8-2399-49fa-9c63-84c1efbd06a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:34.783346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 99/198] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:34.783346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:34.784830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.878275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a93d8-2399-49fa-9c63-84c1efbd06a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:34.880038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a93d8-2399-49fa-9c63-84c1efbd06a6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:34.913418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798bd40-27b6-4a26-ba60-8be66becd274 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:34.954921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:34.972755 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf129-5438-4b5c-b66a-56d5965d2d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:34.973602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf129-5438-4b5c-b66a-56d5965d2d95 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:34.974117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf129-5438-4b5c-b66a-56d5965d2d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:34.974665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bf129-5438-4b5c-b66a-56d5965d2d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.028515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 100/199] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:35.029339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a93d8-2399-49fa-9c63-84c1efbd06a6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.082294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bf129-5438-4b5c-b66a-56d5965d2d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.084106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bf129-5438-4b5c-b66a-56d5965d2d95 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.086621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.165168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a93d8-2399-49fa-9c63-84c1efbd06a6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.202316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494e67-0e55-4a59-83f0-3d67808ad518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.203724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494e67-0e55-4a59-83f0-3d67808ad518 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.204300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494e67-0e55-4a59-83f0-3d67808ad518 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.204765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494e67-0e55-4a59-83f0-3d67808ad518 None admin] PATH_INFO: `/v3/users/aba76b5071ad45debc33032ede796ee3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.206284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494e67-0e55-4a59-83f0-3d67808ad518 None admin] RBAC: Authorizing `identity:get_user(user_id=aba76b5071ad45debc33032ede796ee3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.208004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494e67-0e55-4a59-83f0-3d67808ad518 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.208526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 100/200] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:35.209366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf129-5438-4b5c-b66a-56d5965d2d95 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.210761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 101/201] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/users/aba76b5071ad45debc33032ede796ee3 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.215901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494e67-0e55-4a59-83f0-3d67808ad518 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.245901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.342929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494e67-0e55-4a59-83f0-3d67808ad518 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.358839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bf129-5438-4b5c-b66a-56d5965d2d95 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.363369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.391176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb485d32-5a4b-4f3f-8b44-27aea69ec1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.393312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485d32-5a4b-4f3f-8b44-27aea69ec1da None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.393312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485d32-5a4b-4f3f-8b44-27aea69ec1da None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.393312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485d32-5a4b-4f3f-8b44-27aea69ec1da None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.395464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb485d32-5a4b-4f3f-8b44-27aea69ec1da None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.398111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb485d32-5a4b-4f3f-8b44-27aea69ec1da None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.401204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 102/202] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.402855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb485d32-5a4b-4f3f-8b44-27aea69ec1da None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.426817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c337d-d97b-4612-b583-4b0afc104451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.428753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c337d-d97b-4612-b583-4b0afc104451 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.429243 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c337d-d97b-4612-b583-4b0afc104451 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.429734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c337d-d97b-4612-b583-4b0afc104451 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.431363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c337d-d97b-4612-b583-4b0afc104451 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.434032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c337d-d97b-4612-b583-4b0afc104451 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.437403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 101/203] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.438487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c337d-d97b-4612-b583-4b0afc104451 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.517959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.525627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb485d32-5a4b-4f3f-8b44-27aea69ec1da None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.567964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b43dc-0a9c-464e-bf4b-04b5f3280150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.570027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b43dc-0a9c-464e-bf4b-04b5f3280150 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.570487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b43dc-0a9c-464e-bf4b-04b5f3280150 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.570955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b43dc-0a9c-464e-bf4b-04b5f3280150 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.575983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c337d-d97b-4612-b583-4b0afc104451 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.619990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.620954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.622514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.623013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.624491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] RBAC: Adding query filter params (role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b, user.id=bc517f7fc5664949a2821d701a44a233) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.624979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.627386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.635555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 102/204] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/role_assignments?user.id=bc517f7fc5664949a2821d701a44a233&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.636667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:35.675297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b43dc-0a9c-464e-bf4b-04b5f3280150 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.677076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b43dc-0a9c-464e-bf4b-04b5f3280150 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.686030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.771369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b4324-11f4-4075-845b-b106dadfb931 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:35.814379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:35.815886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:35.816449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:35.816880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:35.817884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b, user.id=bc517f7fc5664949a2821d701a44a233) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:35.818432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:35.820500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:35.828803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 103/205] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/role_assignments?user.id=bc517f7fc5664949a2821d701a44a233&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=07de3e1931ca4d799df8510428e181aa => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:35.899668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:35.909459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 103/206] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:35.915535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.066311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:36.075641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bba8ba-1689-49a2-81a9-ec85b59e4b9c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.115470 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794667a-ac6e-4704-90bd-269984c20229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.116350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794667a-ac6e-4704-90bd-269984c20229 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.117163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794667a-ac6e-4704-90bd-269984c20229 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.117437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794667a-ac6e-4704-90bd-269984c20229 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.118702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794667a-ac6e-4704-90bd-269984c20229 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.120143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794667a-ac6e-4704-90bd-269984c20229 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.122890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 104/207] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:35 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:36.128623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b43dc-0a9c-464e-bf4b-04b5f3280150 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:36.238270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b43dc-0a9c-464e-bf4b-04b5f3280150 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:36.295828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67294646-40eb-416c-b18f-f7db1f051d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:36.296564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67294646-40eb-416c-b18f-f7db1f051d7d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:36.296851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67294646-40eb-416c-b18f-f7db1f051d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:36.297128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67294646-40eb-416c-b18f-f7db1f051d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:36.297979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67294646-40eb-416c-b18f-f7db1f051d7d None admin] RBAC: Adding query filter params (role.id=d2eaae75b1564805bb53d47f30537783, scope.project.id=3c571faec99847838c665f0fa1909346, user.id=aba76b5071ad45debc33032ede796ee3) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:36.298358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67294646-40eb-416c-b18f-f7db1f051d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:36.300086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67294646-40eb-416c-b18f-f7db1f051d7d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:36.312739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 104/208] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:36 2022] GET /identity/v3/role_assignments?user.id=aba76b5071ad45debc33032ede796ee3&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=d2eaae75b1564805bb53d47f30537783 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.120177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4e26-0fde-4e9a-97a3-5924af9fd879 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.120685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4e26-0fde-4e9a-97a3-5924af9fd879 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.120759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de4e26-0fde-4e9a-97a3-5924af9fd879 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.122408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 105/209] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:37.129045 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ea35-a1d6-4d8a-9f56-c784de50ab46 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.129543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ea35-a1d6-4d8a-9f56-c784de50ab46 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.129729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159ea35-a1d6-4d8a-9f56-c784de50ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.151738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e159ea35-a1d6-4d8a-9f56-c784de50ab46 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:37.153805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e159ea35-a1d6-4d8a-9f56-c784de50ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:37.217756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.232294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 105/210] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:37.256062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de4e26-0fde-4e9a-97a3-5924af9fd879 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.385695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de4e26-0fde-4e9a-97a3-5924af9fd879 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.409123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6920-92e9-45b9-8353-17a82cb489bf None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.409641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6920-92e9-45b9-8353-17a82cb489bf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.410130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6920-92e9-45b9-8353-17a82cb489bf None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.412018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 106/211] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:37.419815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581aee-e9ee-48bc-9417-835ee488a362 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.420310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581aee-e9ee-48bc-9417-835ee488a362 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.420604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74581aee-e9ee-48bc-9417-835ee488a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.435677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c411e3-c957-404a-a620-676cba9c33e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.436502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c411e3-c957-404a-a620-676cba9c33e7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.436782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c411e3-c957-404a-a620-676cba9c33e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.437184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c411e3-c957-404a-a620-676cba9c33e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.439447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-74581aee-e9ee-48bc-9417-835ee488a362 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:37.440790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-74581aee-e9ee-48bc-9417-835ee488a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:37.456013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c411e3-c957-404a-a620-676cba9c33e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-97c411e3-c957-404a-a620-676cba9c33e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:37.468401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:37.469885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:37.471840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 106/212] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:37.476467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c411e3-c957-404a-a620-676cba9c33e7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.523737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.530861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 107/213] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:37.551809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74581aee-e9ee-48bc-9417-835ee488a362 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.611107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c411e3-c957-404a-a620-676cba9c33e7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.649313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.650017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.650367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.650737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.651552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:37.651929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.654671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.664687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 107/214] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:37.667518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74581aee-e9ee-48bc-9417-835ee488a362 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.670492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.688975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.708516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e331b-1a18-4fe3-bf06-d2ce94b241bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.709647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e331b-1a18-4fe3-bf06-d2ce94b241bf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.710187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e331b-1a18-4fe3-bf06-d2ce94b241bf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.710666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e331b-1a18-4fe3-bf06-d2ce94b241bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.712109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e331b-1a18-4fe3-bf06-d2ce94b241bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.713931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e331b-1a18-4fe3-bf06-d2ce94b241bf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.717689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 108/215] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:37.723472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e331b-1a18-4fe3-bf06-d2ce94b241bf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.787336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:37.803127 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377957a-5ea9-4d4a-bb2d-944529bf9ad3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.849574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bb52-53e2-4021-bef6-c9f172a6fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.850466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bb52-53e2-4021-bef6-c9f172a6fb45 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.850774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bb52-53e2-4021-bef6-c9f172a6fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.851047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403bb52-53e2-4021-bef6-c9f172a6fb45 None admin] PATH_INFO: `/v3/users/d0018e3f234440fcbcb75b023b1d10a0` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.869279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e331b-1a18-4fe3-bf06-d2ce94b241bf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:37.870311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403bb52-53e2-4021-bef6-c9f172a6fb45 None admin] RBAC: Authorizing `identity:get_user(user_id=d0018e3f234440fcbcb75b023b1d10a0)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.872725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403bb52-53e2-4021-bef6-c9f172a6fb45 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.879020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 108/216] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/users/d0018e3f234440fcbcb75b023b1d10a0 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:37.884018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bb52-53e2-4021-bef6-c9f172a6fb45 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:37.920346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2b2d-5f33-4584-8ed8-eb5a3cc856a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:37.921636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2b2d-5f33-4584-8ed8-eb5a3cc856a8 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:37.922099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2b2d-5f33-4584-8ed8-eb5a3cc856a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:37.922602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f2b2d-5f33-4584-8ed8-eb5a3cc856a8 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:37.923791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2b2d-5f33-4584-8ed8-eb5a3cc856a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:37.926424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f2b2d-5f33-4584-8ed8-eb5a3cc856a8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:37.999177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403bb52-53e2-4021-bef6-c9f172a6fb45 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.021055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 109/217] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:24:37 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:38.042216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a26c7-2265-4092-82e3-f0f519c1e283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.044099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a26c7-2265-4092-82e3-f0f519c1e283 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.044763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a26c7-2265-4092-82e3-f0f519c1e283 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.045334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a26c7-2265-4092-82e3-f0f519c1e283 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.065826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.133293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a26c7-2265-4092-82e3-f0f519c1e283 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.135625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a26c7-2265-4092-82e3-f0f519c1e283 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.255002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 109/218] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:38.264531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2b2d-5f33-4584-8ed8-eb5a3cc856a8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.320726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.391679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f2b2d-5f33-4584-8ed8-eb5a3cc856a8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.424602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96eb8-15c0-4536-9532-148dad20b43c None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.425364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96eb8-15c0-4536-9532-148dad20b43c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.425869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c96eb8-15c0-4536-9532-148dad20b43c None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.428087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 110/219] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:38.431871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7078670-3772-4660-befd-27c842d41bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.432029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078670-3772-4660-befd-27c842d41bdc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.432311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078670-3772-4660-befd-27c842d41bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.432587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078670-3772-4660-befd-27c842d41bdc None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.435107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d72841-b008-457f-a6fe-88f76fabb00a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.435241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7078670-3772-4660-befd-27c842d41bdc None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.435721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d72841-b008-457f-a6fe-88f76fabb00a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.436209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d72841-b008-457f-a6fe-88f76fabb00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.436690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7078670-3772-4660-befd-27c842d41bdc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.439792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 110/220] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:38.445501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7078670-3772-4660-befd-27c842d41bdc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.460371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-01d72841-b008-457f-a6fe-88f76fabb00a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:38.461981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-01d72841-b008-457f-a6fe-88f76fabb00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:38.526307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.555714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 111/221] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:38.557130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73cef-c3a2-439d-9e62-f5aa6af4a3cd None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.557706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73cef-c3a2-439d-9e62-f5aa6af4a3cd None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.558208 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab73cef-c3a2-439d-9e62-f5aa6af4a3cd None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.560646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 112/222] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:38.566228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db7e1-3349-4692-b27e-2852d98c3d53 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.566509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db7e1-3349-4692-b27e-2852d98c3d53 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.566809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536db7e1-3349-4692-b27e-2852d98c3d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.576785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7078670-3772-4660-befd-27c842d41bdc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.584228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-536db7e1-3349-4692-b27e-2852d98c3d53 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:38.585408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-536db7e1-3349-4692-b27e-2852d98c3d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:38.595246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.626860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.627541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.627824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.628103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.628948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] RBAC: Adding query filter params (role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b, user.id=d0018e3f234440fcbcb75b023b1d10a0) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:38.629754 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:38.631267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:38.639862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 111/223] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/role_assignments?user.id=d0018e3f234440fcbcb75b023b1d10a0&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:38.640851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.662121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 113/224] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:38.685510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db7e1-3349-4692-b27e-2852d98c3d53 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.802067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536db7e1-3349-4692-b27e-2852d98c3d53 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.811427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:38.847836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e0ef-edf7-42f4-80c4-ba6894abcf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.848679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e0ef-edf7-42f4-80c4-ba6894abcf9a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.849065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e0ef-edf7-42f4-80c4-ba6894abcf9a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.849523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e0ef-edf7-42f4-80c4-ba6894abcf9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.850231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfc2a44-607c-47a3-91bc-b0a8626d2f9a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:38.888877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999e0ef-edf7-42f4-80c4-ba6894abcf9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:38.892848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444879-0625-49ae-a5dd-ba387ed46e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:38.893666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444879-0625-49ae-a5dd-ba387ed46e5a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:38.893952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444879-0625-49ae-a5dd-ba387ed46e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:38.899665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20444879-0625-49ae-a5dd-ba387ed46e5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b999e0ef-edf7-42f4-80c4-ba6894abcf9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:38.914567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:38.915501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:38.916286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20444879-0625-49ae-a5dd-ba387ed46e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-20444879-0625-49ae-a5dd-ba387ed46e5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:38.916879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:38.917569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:38.919310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 112/225] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:38.921583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 114/226] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:38.922586 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444879-0625-49ae-a5dd-ba387ed46e5a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.927797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e0ef-edf7-42f4-80c4-ba6894abcf9a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:38.999727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.054996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e0ef-edf7-42f4-80c4-ba6894abcf9a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.104075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.105066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.106083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.107322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.108296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.108788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.110407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.120430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 115/227] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:39.131583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.147081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20444879-0625-49ae-a5dd-ba387ed46e5a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.178728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.186113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.187059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.190281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.190281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.190281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:39.190281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.190281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.201395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 113/228] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:39.207516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.316941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.323412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5eaaff-c022-48bf-ab8a-c2dcfa518669 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.357221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7394c6-1f3d-4939-9b46-cea876aa9438 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.360700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25c36a-368e-45e6-bfda-2f00c2ba1aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.361824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25c36a-368e-45e6-bfda-2f00c2ba1aec None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.362284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25c36a-368e-45e6-bfda-2f00c2ba1aec None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.362759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25c36a-368e-45e6-bfda-2f00c2ba1aec None admin] PATH_INFO: `/v3/users/bc517f7fc5664949a2821d701a44a233` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.364152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25c36a-368e-45e6-bfda-2f00c2ba1aec None admin] RBAC: Authorizing `identity:get_user(user_id=bc517f7fc5664949a2821d701a44a233)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.365767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25c36a-368e-45e6-bfda-2f00c2ba1aec None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.368241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 114/229] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/users/bc517f7fc5664949a2821d701a44a233 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.377591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25c36a-368e-45e6-bfda-2f00c2ba1aec None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.463839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a7af8-b3f4-4d46-9c9a-1b6d6eb07353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.465232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7af8-b3f4-4d46-9c9a-1b6d6eb07353 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.465664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7af8-b3f4-4d46-9c9a-1b6d6eb07353 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.466100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a7af8-b3f4-4d46-9c9a-1b6d6eb07353 None admin] PATH_INFO: `/v3/users/bc517f7fc5664949a2821d701a44a233` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.471696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a7af8-b3f4-4d46-9c9a-1b6d6eb07353 None admin] RBAC: Authorizing `identity:get_user(user_id=bc517f7fc5664949a2821d701a44a233)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.473405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a7af8-b3f4-4d46-9c9a-1b6d6eb07353 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.475255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 116/230] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/users/bc517f7fc5664949a2821d701a44a233 => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.481102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a7af8-b3f4-4d46-9c9a-1b6d6eb07353 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.486407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25c36a-368e-45e6-bfda-2f00c2ba1aec None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.537271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fbf1-aafd-4b1c-b8d4-e34709ca2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.538453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fbf1-aafd-4b1c-b8d4-e34709ca2539 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.539101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fbf1-aafd-4b1c-b8d4-e34709ca2539 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.540726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923fbf1-aafd-4b1c-b8d4-e34709ca2539 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.543504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923fbf1-aafd-4b1c-b8d4-e34709ca2539 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.545786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923fbf1-aafd-4b1c-b8d4-e34709ca2539 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.549974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 115/231] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:39.556147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fbf1-aafd-4b1c-b8d4-e34709ca2539 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.645121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.733985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:39.747853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a7af8-b3f4-4d46-9c9a-1b6d6eb07353 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.794372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150cf0-48d9-45ab-b2d4-a48e07b0ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.795700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150cf0-48d9-45ab-b2d4-a48e07b0ea65 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.796132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150cf0-48d9-45ab-b2d4-a48e07b0ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.797071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63150cf0-48d9-45ab-b2d4-a48e07b0ea65 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.798975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150cf0-48d9-45ab-b2d4-a48e07b0ea65 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.800661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63150cf0-48d9-45ab-b2d4-a48e07b0ea65 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.803034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 117/232] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:39 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:39.811898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150cf0-48d9-45ab-b2d4-a48e07b0ea65 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:39.817505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923fbf1-aafd-4b1c-b8d4-e34709ca2539 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.884224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501bcfa0-3276-4aab-91c8-319501e190fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:39.885139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bcfa0-3276-4aab-91c8-319501e190fa None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:39.885422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bcfa0-3276-4aab-91c8-319501e190fa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:39.885693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501bcfa0-3276-4aab-91c8-319501e190fa None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/users/bc517f7fc5664949a2821d701a44a233/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:39.890772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bcfa0-3276-4aab-91c8-319501e190fa None admin] RBAC: Authorizing `identity:create_grant(project_id=7038bd1c4ee44ca29197ba920c0fde7b, user_id=bc517f7fc5664949a2821d701a44a233, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:39.892239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501bcfa0-3276-4aab-91c8-319501e190fa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:39.959307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63150cf0-48d9-45ab-b2d4-a48e07b0ea65 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:39.981282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 116/233] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:39 2022] PUT /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/users/bc517f7fc5664949a2821d701a44a233/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:40.008285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcacf82-171b-417c-be8e-c3bb3862b0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:40.009200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacf82-171b-417c-be8e-c3bb3862b0f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.009531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacf82-171b-417c-be8e-c3bb3862b0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.009807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcacf82-171b-417c-be8e-c3bb3862b0f6 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/users/bc517f7fc5664949a2821d701a44a233/roles/af8d06df2b8647859f2fe7b60e0da912` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.013311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcacf82-171b-417c-be8e-c3bb3862b0f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7038bd1c4ee44ca29197ba920c0fde7b, user_id=bc517f7fc5664949a2821d701a44a233, role_id=af8d06df2b8647859f2fe7b60e0da912)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:40.014904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcacf82-171b-417c-be8e-c3bb3862b0f6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:40.135251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 118/234] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:39 2022] PUT /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/users/bc517f7fc5664949a2821d701a44a233/roles/af8d06df2b8647859f2fe7b60e0da912 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:40.983171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d5885-70b1-4028-97df-77c8cdacb74d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.983696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d5885-70b1-4028-97df-77c8cdacb74d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.983770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d5885-70b1-4028-97df-77c8cdacb74d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:40.985327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 117/235] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:40.990844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02602-77ce-45b1-b1db-578dd3621128 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:40.991287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02602-77ce-45b1-b1db-578dd3621128 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:40.991466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02602-77ce-45b1-b1db-578dd3621128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.015605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5de02602-77ce-45b1-b1db-578dd3621128 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:41.016829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5de02602-77ce-45b1-b1db-578dd3621128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:41.037419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.092736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 119/236] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:41.113100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196d31-1aef-45d2-96a1-740f7eac82a4 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.113713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196d31-1aef-45d2-96a1-740f7eac82a4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.114191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65196d31-1aef-45d2-96a1-740f7eac82a4 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.115870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 118/237] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:41.122791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588c0f6-344a-40f1-bcf4-c4718f256d2e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.123353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588c0f6-344a-40f1-bcf4-c4718f256d2e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.123823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588c0f6-344a-40f1-bcf4-c4718f256d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.131911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65196d31-1aef-45d2-96a1-740f7eac82a4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.165686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-1588c0f6-344a-40f1-bcf4-c4718f256d2e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:41.171233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-1588c0f6-344a-40f1-bcf4-c4718f256d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:41.258430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 120/238] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:41.289094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588c0f6-344a-40f1-bcf4-c4718f256d2e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.399606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.399962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.414283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65196d31-1aef-45d2-96a1-740f7eac82a4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.418223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588c0f6-344a-40f1-bcf4-c4718f256d2e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.455434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0c7ac-b656-49c7-9545-f3e2797b3283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.456474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0c7ac-b656-49c7-9545-f3e2797b3283 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.456920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0c7ac-b656-49c7-9545-f3e2797b3283 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.457379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0c7ac-b656-49c7-9545-f3e2797b3283 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.459204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9abcb3-2baf-4996-8d90-13c35665c453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.460657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9abcb3-2baf-4996-8d90-13c35665c453 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.461093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9abcb3-2baf-4996-8d90-13c35665c453 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.461534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9abcb3-2baf-4996-8d90-13c35665c453 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.463216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9abcb3-2baf-4996-8d90-13c35665c453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.465861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9abcb3-2baf-4996-8d90-13c35665c453 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.468161 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 119/239] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:41.469973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d0b1-1878-4ecc-bce7-2bea7546c15f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.470603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d0b1-1878-4ecc-bce7-2bea7546c15f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.470785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0c7ac-b656-49c7-9545-f3e2797b3283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:41.471132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563d0b1-1878-4ecc-bce7-2bea7546c15f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.472496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 120/240] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:41.477270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563d0b1-1878-4ecc-bce7-2bea7546c15f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-f3a0c7ac-b656-49c7-9545-f3e2797b3283 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:41.485510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:41.486647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 121/241] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:41.487622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec33a2a-f3bb-4daa-b556-d0239a1c0e10 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.488472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec33a2a-f3bb-4daa-b556-d0239a1c0e10 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.488472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec33a2a-f3bb-4daa-b556-d0239a1c0e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.505415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-aec33a2a-f3bb-4daa-b556-d0239a1c0e10 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:41.507971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-aec33a2a-f3bb-4daa-b556-d0239a1c0e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:41.608391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563d0b1-1878-4ecc-bce7-2bea7546c15f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.612989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 122/242] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:41.619518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec33a2a-f3bb-4daa-b556-d0239a1c0e10 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.661702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7055f8-2152-4232-81ef-6828eff3bdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.662403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7055f8-2152-4232-81ef-6828eff3bdf8 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.662738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7055f8-2152-4232-81ef-6828eff3bdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.663011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7055f8-2152-4232-81ef-6828eff3bdf8 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.663760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7055f8-2152-4232-81ef-6828eff3bdf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.665340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7055f8-2152-4232-81ef-6828eff3bdf8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.721623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.748117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec33a2a-f3bb-4daa-b556-d0239a1c0e10 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:41.765417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 121/243] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:24:41 2022] POST /identity/v3/users => generated 293 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:41.766957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7055f8-2152-4232-81ef-6828eff3bdf8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.803803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:41.813655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:41.814718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:41.815158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:41.815585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:41.816533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:41.816995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:41.818559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:41.838695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 123/244] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:41.844623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:41.986146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7055f8-2152-4232-81ef-6828eff3bdf8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.035831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f21297-f05b-4f18-a6e3-b79f40e2c05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.036705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f21297-f05b-4f18-a6e3-b79f40e2c05f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.036988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f21297-f05b-4f18-a6e3-b79f40e2c05f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.037264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f21297-f05b-4f18-a6e3-b79f40e2c05f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.050087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f21297-f05b-4f18-a6e3-b79f40e2c05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:42.050626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef6f0d-b209-4a5f-b790-9bb1c2ddf7a2 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-59f21297-f05b-4f18-a6e3-b79f40e2c05f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:42.058079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:42.059601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:42.060387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 122/245] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:42.065476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f21297-f05b-4f18-a6e3-b79f40e2c05f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.090911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a7b8e-24f2-4c88-a249-d0f2373e194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.091969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a7b8e-24f2-4c88-a249-d0f2373e194c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.092291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a7b8e-24f2-4c88-a249-d0f2373e194c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.092566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a7b8e-24f2-4c88-a249-d0f2373e194c None admin] PATH_INFO: `/v3/users/bc53c89c781f4fe4a17a6340316f9044` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.095694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.110241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a7b8e-24f2-4c88-a249-d0f2373e194c None admin] RBAC: Authorizing `identity:get_user(user_id=bc53c89c781f4fe4a17a6340316f9044)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.112200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a7b8e-24f2-4c88-a249-d0f2373e194c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.114581 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 124/246] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:41 2022] GET /identity/v3/users/bc53c89c781f4fe4a17a6340316f9044 => generated 297 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:42.120878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a7b8e-24f2-4c88-a249-d0f2373e194c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.156886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.181756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f21297-f05b-4f18-a6e3-b79f40e2c05f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.220129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.220823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.221106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.221385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.222152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.222555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.223971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.233905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 123/247] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:42.239574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.239826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a7b8e-24f2-4c88-a249-d0f2373e194c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.280281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd7dca-ce8b-474e-9c78-c129442a030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.281120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7dca-ce8b-474e-9c78-c129442a030c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.281411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7dca-ce8b-474e-9c78-c129442a030c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.288943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd7dca-ce8b-474e-9c78-c129442a030c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.393198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.399245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113f370-a216-472d-9495-88d5522a7f15 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.402960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd7dca-ce8b-474e-9c78-c129442a030c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.404992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd7dca-ce8b-474e-9c78-c129442a030c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.440729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e299c-f551-4d85-ad10-ef163280c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.441887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e299c-f551-4d85-ad10-ef163280c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.442308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e299c-f551-4d85-ad10-ef163280c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.442911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e299c-f551-4d85-ad10-ef163280c0b0 None admin] PATH_INFO: `/v3/users/d0018e3f234440fcbcb75b023b1d10a0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.444782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e299c-f551-4d85-ad10-ef163280c0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=d0018e3f234440fcbcb75b023b1d10a0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.446418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e299c-f551-4d85-ad10-ef163280c0b0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.448588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 124/248] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/users/d0018e3f234440fcbcb75b023b1d10a0 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:42.454514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e299c-f551-4d85-ad10-ef163280c0b0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.470921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.538328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 125/249] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:24:42.544850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd7dca-ce8b-474e-9c78-c129442a030c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.585902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e299c-f551-4d85-ad10-ef163280c0b0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.626879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4545cca-d5a6-4dc9-acee-b35dbf72c31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.627813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4545cca-d5a6-4dc9-acee-b35dbf72c31a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.628090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4545cca-d5a6-4dc9-acee-b35dbf72c31a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.629254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4545cca-d5a6-4dc9-acee-b35dbf72c31a None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.631032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4545cca-d5a6-4dc9-acee-b35dbf72c31a None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.632519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4545cca-d5a6-4dc9-acee-b35dbf72c31a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.634659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 125/250] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:42.642180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4545cca-d5a6-4dc9-acee-b35dbf72c31a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.661530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.670005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd7dca-ce8b-474e-9c78-c129442a030c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.709130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3696b2-d1d2-4e3a-98cb-a8657ca43c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.711409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3696b2-d1d2-4e3a-98cb-a8657ca43c68 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.711954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3696b2-d1d2-4e3a-98cb-a8657ca43c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.712427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3696b2-d1d2-4e3a-98cb-a8657ca43c68 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.713970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3696b2-d1d2-4e3a-98cb-a8657ca43c68 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.716646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3696b2-d1d2-4e3a-98cb-a8657ca43c68 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.719377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 126/251] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:42.725892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3696b2-d1d2-4e3a-98cb-a8657ca43c68 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:42.768908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:42.810233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4545cca-d5a6-4dc9-acee-b35dbf72c31a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.851296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3696b2-d1d2-4e3a-98cb-a8657ca43c68 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:42.864950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1657447f-38ea-4a1d-8a77-ae38acc47678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.866639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657447f-38ea-4a1d-8a77-ae38acc47678 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.867403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657447f-38ea-4a1d-8a77-ae38acc47678 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.867870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1657447f-38ea-4a1d-8a77-ae38acc47678 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/users/d0018e3f234440fcbcb75b023b1d10a0/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.871514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657447f-38ea-4a1d-8a77-ae38acc47678 None admin] RBAC: Authorizing `identity:create_grant(project_id=7038bd1c4ee44ca29197ba920c0fde7b, user_id=d0018e3f234440fcbcb75b023b1d10a0, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.873571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1657447f-38ea-4a1d-8a77-ae38acc47678 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.898194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e24b9a-4a6d-4496-8d75-a5b58d05c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:42.899175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e24b9a-4a6d-4496-8d75-a5b58d05c678 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.899570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e24b9a-4a6d-4496-8d75-a5b58d05c678 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.899904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e24b9a-4a6d-4496-8d75-a5b58d05c678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.900857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e24b9a-4a6d-4496-8d75-a5b58d05c678 None admin] RBAC: Adding query filter params (role.id=d2eaae75b1564805bb53d47f30537783, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b, user.id=bc53c89c781f4fe4a17a6340316f9044) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:42.901234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e24b9a-4a6d-4496-8d75-a5b58d05c678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:42.903560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e24b9a-4a6d-4496-8d75-a5b58d05c678 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:42.910627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 127/252] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:42 2022] GET /identity/v3/role_assignments?user.id=bc53c89c781f4fe4a17a6340316f9044&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=d2eaae75b1564805bb53d47f30537783 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:42.912339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c42f9-2db9-43a2-9e9a-cfe502842c45 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.912692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c42f9-2db9-43a2-9e9a-cfe502842c45 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.913031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c42f9-2db9-43a2-9e9a-cfe502842c45 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.914504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 128/253] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:42.926235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936c50-9f32-4aba-8544-619601872ffb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:42.926538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936c50-9f32-4aba-8544-619601872ffb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:42.926816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936c50-9f32-4aba-8544-619601872ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:42.956074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ec936c50-9f32-4aba-8544-619601872ffb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:42.957284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ec936c50-9f32-4aba-8544-619601872ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:42.962915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 126/254] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:42 2022] PUT /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/users/d0018e3f234440fcbcb75b023b1d10a0/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:43.019040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.067532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca8096-0fab-4072-a2a5-0df61fd3d0ff None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.068034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca8096-0fab-4072-a2a5-0df61fd3d0ff None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.068034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca8096-0fab-4072-a2a5-0df61fd3d0ff None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.069898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 127/255] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:43.080341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8373ab4-f848-4294-9438-2836298cf887 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.080776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8373ab4-f848-4294-9438-2836298cf887 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.081130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 129/256] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:43.081561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8373ab4-f848-4294-9438-2836298cf887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.104832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec936c50-9f32-4aba-8544-619601872ffb None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.111861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c8373ab4-f848-4294-9438-2836298cf887 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:43.112427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c8373ab4-f848-4294-9438-2836298cf887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:43.241905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec936c50-9f32-4aba-8544-619601872ffb None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.272602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 128/257] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:43.286918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180bb03-649f-408d-b7be-a128b4f3fd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.286918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bb03-649f-408d-b7be-a128b4f3fd60 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.286918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bb03-649f-408d-b7be-a128b4f3fd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.286918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180bb03-649f-408d-b7be-a128b4f3fd60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.296618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8373ab4-f848-4294-9438-2836298cf887 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.301582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b180bb03-649f-408d-b7be-a128b4f3fd60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b180bb03-649f-408d-b7be-a128b4f3fd60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:43.314382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.315934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:24:43.316907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:43.319273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 130/258] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:43.326027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180bb03-649f-408d-b7be-a128b4f3fd60 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.351053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.374561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.419525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8373ab4-f848-4294-9438-2836298cf887 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.452711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180bb03-649f-408d-b7be-a128b4f3fd60 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.459424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7545791-c571-4069-83ab-dc2d9b5f5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.459424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545791-c571-4069-83ab-dc2d9b5f5e41 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.459778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545791-c571-4069-83ab-dc2d9b5f5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.460187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7545791-c571-4069-83ab-dc2d9b5f5e41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.474672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7545791-c571-4069-83ab-dc2d9b5f5e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e7545791-c571-4069-83ab-dc2d9b5f5e41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:43.483821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:43.484796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:43.485612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 129/259] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:43.493072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7545791-c571-4069-83ab-dc2d9b5f5e41 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.494985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.495901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.496368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.496790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.497774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.498255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.499928 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.510833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 131/260] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:43.517267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.607039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7545791-c571-4069-83ab-dc2d9b5f5e41 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.635067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.637364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.655344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.656141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.656474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.656833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.657659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:43.658028 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.659507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.677294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 130/261] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:43.682869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.690832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbc962-9c1e-4ddf-a5f7-fe148c066ad5 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.783318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c51e9-775b-4da6-803e-fb51b8814d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.784558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c51e9-775b-4da6-803e-fb51b8814d72 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.785037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c51e9-775b-4da6-803e-fb51b8814d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.785477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c51e9-775b-4da6-803e-fb51b8814d72 None admin] PATH_INFO: `/v3/users/bc517f7fc5664949a2821d701a44a233` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.786942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c51e9-775b-4da6-803e-fb51b8814d72 None admin] RBAC: Authorizing `identity:get_user(user_id=bc517f7fc5664949a2821d701a44a233)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.788787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c51e9-775b-4da6-803e-fb51b8814d72 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.789609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cbfef-7c6b-4d6e-8f78-0cde05d3b852 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.791154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 132/262] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/users/bc517f7fc5664949a2821d701a44a233 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:43.797380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c51e9-775b-4da6-803e-fb51b8814d72 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.827596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c627c64-9fba-49e7-acdf-1a1ea147179a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.830554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627c64-9fba-49e7-acdf-1a1ea147179a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.830554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627c64-9fba-49e7-acdf-1a1ea147179a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.830554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c627c64-9fba-49e7-acdf-1a1ea147179a None admin] PATH_INFO: `/v3/users/bc517f7fc5664949a2821d701a44a233` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:43.830817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c627c64-9fba-49e7-acdf-1a1ea147179a None admin] RBAC: Authorizing `identity:get_user(user_id=bc517f7fc5664949a2821d701a44a233)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:43.833602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c627c64-9fba-49e7-acdf-1a1ea147179a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:43.838725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 131/263] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/users/bc517f7fc5664949a2821d701a44a233 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:43.840395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c627c64-9fba-49e7-acdf-1a1ea147179a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:43.906943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:43.951171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c627c64-9fba-49e7-acdf-1a1ea147179a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:43.991891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43a3d2-b82f-44ae-b7b7-c8886226cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:43.992854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43a3d2-b82f-44ae-b7b7-c8886226cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:43.993216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43a3d2-b82f-44ae-b7b7-c8886226cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:43.993558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43a3d2-b82f-44ae-b7b7-c8886226cfc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.065172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c51e9-775b-4da6-803e-fb51b8814d72 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.072601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43a3d2-b82f-44ae-b7b7-c8886226cfc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.074324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43a3d2-b82f-44ae-b7b7-c8886226cfc6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.137302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f00f-56de-4782-8e3e-09af86a4c6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.138687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f00f-56de-4782-8e3e-09af86a4c6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.139130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f00f-56de-4782-8e3e-09af86a4c6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.139555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f00f-56de-4782-8e3e-09af86a4c6f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.167106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.171937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.222640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 132/264] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:44.230183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43a3d2-b82f-44ae-b7b7-c8886226cfc6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.323460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f00f-56de-4782-8e3e-09af86a4c6f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.325696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f00f-56de-4782-8e3e-09af86a4c6f8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.361473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43a3d2-b82f-44ae-b7b7-c8886226cfc6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.397545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f071eed-4a40-4e8b-a3c9-841510bdb223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.398706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f071eed-4a40-4e8b-a3c9-841510bdb223 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.398984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f071eed-4a40-4e8b-a3c9-841510bdb223 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.399250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f071eed-4a40-4e8b-a3c9-841510bdb223 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.400451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f071eed-4a40-4e8b-a3c9-841510bdb223 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.402024 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f071eed-4a40-4e8b-a3c9-841510bdb223 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.407910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 133/265] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:44.410093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f071eed-4a40-4e8b-a3c9-841510bdb223 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.444446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.520601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f071eed-4a40-4e8b-a3c9-841510bdb223 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.554617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 133/266] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:44.558479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.559164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.559444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.559717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.560936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] RBAC: Adding query filter params (role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b, user.id=bc517f7fc5664949a2821d701a44a233) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.561251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.561841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f00f-56de-4782-8e3e-09af86a4c6f8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.562723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.569533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 134/267] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/role_assignments?user.id=bc517f7fc5664949a2821d701a44a233&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:44.650919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.728232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f00f-56de-4782-8e3e-09af86a4c6f8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.775517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084850e5-fe64-48ca-b645-c7ea7e852376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.777325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084850e5-fe64-48ca-b645-c7ea7e852376 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.777812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084850e5-fe64-48ca-b645-c7ea7e852376 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.778370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084850e5-fe64-48ca-b645-c7ea7e852376 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.783319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084850e5-fe64-48ca-b645-c7ea7e852376 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.785042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084850e5-fe64-48ca-b645-c7ea7e852376 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.787587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 134/268] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:44.794882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:44.931458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:44.948831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424691f9-bf27-4137-a977-06d34487e5db None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:44.986988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675c8f2-0a76-46ca-8253-0ce9b0c0950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:44.987583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c8f2-0a76-46ca-8253-0ce9b0c0950a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:44.987866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c8f2-0a76-46ca-8253-0ce9b0c0950a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:44.988149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675c8f2-0a76-46ca-8253-0ce9b0c0950a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:44.988996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675c8f2-0a76-46ca-8253-0ce9b0c0950a None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b, user.id=bc517f7fc5664949a2821d701a44a233) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:44.989306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675c8f2-0a76-46ca-8253-0ce9b0c0950a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:44.990824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675c8f2-0a76-46ca-8253-0ce9b0c0950a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:44.998160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 135/269] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:44 2022] GET /identity/v3/role_assignments?user.id=bc517f7fc5664949a2821d701a44a233&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=07de3e1931ca4d799df8510428e181aa => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:45.799024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f62b-9d3d-435e-b2a3-cacd98626154 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.799982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f62b-9d3d-435e-b2a3-cacd98626154 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.800465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371f62b-9d3d-435e-b2a3-cacd98626154 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.802351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 135/270] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:45.807891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62d5e-dbe5-40ed-950f-8c182c80c087 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.808461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62d5e-dbe5-40ed-950f-8c182c80c087 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.808461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62d5e-dbe5-40ed-950f-8c182c80c087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.830961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a4d62d5e-dbe5-40ed-950f-8c182c80c087 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:45.832227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a4d62d5e-dbe5-40ed-950f-8c182c80c087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:45.918313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e47150-4258-4d65-a42c-c5f6058dbb87 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.918772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e47150-4258-4d65-a42c-c5f6058dbb87 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.919052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e47150-4258-4d65-a42c-c5f6058dbb87 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.920845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 136/271] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:45.927446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659da94d-7fcf-4802-a3bc-a52b37714112 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:45.927740 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659da94d-7fcf-4802-a3bc-a52b37714112 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:45.928009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659da94d-7fcf-4802-a3bc-a52b37714112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:45.934638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 136/272] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:45.945908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-659da94d-7fcf-4802-a3bc-a52b37714112 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:45.947168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-659da94d-7fcf-4802-a3bc-a52b37714112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:45.958364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d62d5e-dbe5-40ed-950f-8c182c80c087 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.027979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 137/273] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:46.051963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a05d2-e7d4-4b63-bd82-eb416aa5db3e None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.052183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a05d2-e7d4-4b63-bd82-eb416aa5db3e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.052424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a05d2-e7d4-4b63-bd82-eb416aa5db3e None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.053953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 138/274] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:46.055394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a05d2-e7d4-4b63-bd82-eb416aa5db3e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.062905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.085286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d62d5e-dbe5-40ed-950f-8c182c80c087 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.128593 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.143032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8fce0-f377-4774-85ca-eaf5599723a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.144074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8fce0-f377-4774-85ca-eaf5599723a5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.144501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8fce0-f377-4774-85ca-eaf5599723a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.144959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8fce0-f377-4774-85ca-eaf5599723a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.157315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8fce0-f377-4774-85ca-eaf5599723a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-fdb8fce0-f377-4774-85ca-eaf5599723a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:46.166434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:46.168382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 137/275] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:46.169486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1502e-bdfd-41ff-9a56-b29a8cbb0d50 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.170207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1502e-bdfd-41ff-9a56-b29a8cbb0d50 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.170207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1502e-bdfd-41ff-9a56-b29a8cbb0d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.187858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b8a1502e-bdfd-41ff-9a56-b29a8cbb0d50 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:46.189048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b8a1502e-bdfd-41ff-9a56-b29a8cbb0d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:46.196385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a05d2-e7d4-4b63-bd82-eb416aa5db3e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.235216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943965a-07a5-4df0-a6c7-d5ee27328362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.236027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943965a-07a5-4df0-a6c7-d5ee27328362 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.236304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943965a-07a5-4df0-a6c7-d5ee27328362 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.236574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943965a-07a5-4df0-a6c7-d5ee27328362 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.249962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943965a-07a5-4df0-a6c7-d5ee27328362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-1943965a-07a5-4df0-a6c7-d5ee27328362 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:46.257774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:46.258805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:46.259613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 139/276] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:46.260602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943965a-07a5-4df0-a6c7-d5ee27328362 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.271185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 138/277] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:46.272063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1502e-bdfd-41ff-9a56-b29a8cbb0d50 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.355958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.375539 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943965a-07a5-4df0-a6c7-d5ee27328362 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.378803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.389521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1502e-bdfd-41ff-9a56-b29a8cbb0d50 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.418798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9bd95-962b-4f44-bfa0-e216b966ae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.420204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9bd95-962b-4f44-bfa0-e216b966ae60 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.420522 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9bd95-962b-4f44-bfa0-e216b966ae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.420861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9bd95-962b-4f44-bfa0-e216b966ae60 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.421881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9bd95-962b-4f44-bfa0-e216b966ae60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.422789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9bd95-962b-4f44-bfa0-e216b966ae60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.424230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9bd95-962b-4f44-bfa0-e216b966ae60 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.427383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.428060 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.428359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.428653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.429453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.429769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.431222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.433358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 140/278] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.439284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccafe9-75aa-4f31-bd34-5159129d629f None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.439572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccafe9-75aa-4f31-bd34-5159129d629f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.439848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccafe9-75aa-4f31-bd34-5159129d629f None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.444898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 139/279] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.444898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.445136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 141/280] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:46.445136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccafe9-75aa-4f31-bd34-5159129d629f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.557824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccafe9-75aa-4f31-bd34-5159129d629f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.565516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcb77f-5959-4930-82d9-fdd225125409 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.594596 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9e191-9d8a-486d-9aa3-e30b012ecd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.595489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e191-9d8a-486d-9aa3-e30b012ecd4b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.595774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e191-9d8a-486d-9aa3-e30b012ecd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.596049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9e191-9d8a-486d-9aa3-e30b012ecd4b None admin] PATH_INFO: `/v3/users/660dff57619345b3b3f0bf33bcb65bd0` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.596484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.601477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295d25-0f8b-44b0-b43d-23d6015a34fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.602272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295d25-0f8b-44b0-b43d-23d6015a34fd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.602580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295d25-0f8b-44b0-b43d-23d6015a34fd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.602859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295d25-0f8b-44b0-b43d-23d6015a34fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.604021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295d25-0f8b-44b0-b43d-23d6015a34fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.606474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295d25-0f8b-44b0-b43d-23d6015a34fd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.608081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 140/281] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.608905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295d25-0f8b-44b0-b43d-23d6015a34fd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.613318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9e191-9d8a-486d-9aa3-e30b012ecd4b None admin] RBAC: Authorizing `identity:get_user(user_id=660dff57619345b3b3f0bf33bcb65bd0)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.614892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9e191-9d8a-486d-9aa3-e30b012ecd4b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.621545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 142/282] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/users/660dff57619345b3b3f0bf33bcb65bd0 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.621545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb763f7-c06a-4cf5-9c75-b639ad8030a2 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.621545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb763f7-c06a-4cf5-9c75-b639ad8030a2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.621545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb763f7-c06a-4cf5-9c75-b639ad8030a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.636520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-cbb763f7-c06a-4cf5-9c75-b639ad8030a2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:46.637991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cbb763f7-c06a-4cf5-9c75-b639ad8030a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:46.657365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.708153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 143/283] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:46.711378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb763f7-c06a-4cf5-9c75-b639ad8030a2 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.722327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295d25-0f8b-44b0-b43d-23d6015a34fd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.759595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d649a-0c51-45c9-901e-985cab06814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.760475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d649a-0c51-45c9-901e-985cab06814d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.760766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d649a-0c51-45c9-901e-985cab06814d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.761709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d649a-0c51-45c9-901e-985cab06814d None admin] PATH_INFO: `/v3/users/bc53c89c781f4fe4a17a6340316f9044` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.763099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d649a-0c51-45c9-901e-985cab06814d None admin] RBAC: Authorizing `identity:get_user(user_id=bc53c89c781f4fe4a17a6340316f9044)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.764537 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d649a-0c51-45c9-901e-985cab06814d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.766204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 141/284] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/users/bc53c89c781f4fe4a17a6340316f9044 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.766975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d649a-0c51-45c9-901e-985cab06814d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.832439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb763f7-c06a-4cf5-9c75-b639ad8030a2 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.844415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:46.871159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cfe9c-24b9-4728-b664-a61407bbfd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.871159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cfe9c-24b9-4728-b664-a61407bbfd67 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.871159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cfe9c-24b9-4728-b664-a61407bbfd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.871159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cfe9c-24b9-4728-b664-a61407bbfd67 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.871648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cfe9c-24b9-4728-b664-a61407bbfd67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.873060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cfe9c-24b9-4728-b664-a61407bbfd67 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.880154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d649a-0c51-45c9-901e-985cab06814d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:46.915619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:46.916280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:46.916563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:46.916838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:46.917825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] RBAC: Adding query filter params (role.id=b6f4cd580a914b0aa8c3a237d63e5350, user.id=660dff57619345b3b3f0bf33bcb65bd0, scope.system=all) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:46.918136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:46.919633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:46.924865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 142/285] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/role_assignments?user.id=660dff57619345b3b3f0bf33bcb65bd0&scope.system=all&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:46.925696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.963021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 144/286] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:24:46 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:46.964229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cfe9c-24b9-4728-b664-a61407bbfd67 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:46.980682 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.067410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964e61f-8333-4ce2-bab7-0b26f7e3ac4b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.106332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cfe9c-24b9-4728-b664-a61407bbfd67 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.109608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.115130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc39f6a-11ad-4c17-85d8-99cee17e59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.115967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc39f6a-11ad-4c17-85d8-99cee17e59c8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.116248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc39f6a-11ad-4c17-85d8-99cee17e59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.116521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc39f6a-11ad-4c17-85d8-99cee17e59c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.130398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc39f6a-11ad-4c17-85d8-99cee17e59c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9cc39f6a-11ad-4c17-85d8-99cee17e59c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:47.139347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:47.140494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:47.141490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:47.143545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 143/287] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:47.149395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc39f6a-11ad-4c17-85d8-99cee17e59c8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.157971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4448b6-e0ac-4943-aa2b-c0d8db8b5854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.158888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4448b6-e0ac-4943-aa2b-c0d8db8b5854 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.159166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4448b6-e0ac-4943-aa2b-c0d8db8b5854 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.159438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4448b6-e0ac-4943-aa2b-c0d8db8b5854 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.160749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4448b6-e0ac-4943-aa2b-c0d8db8b5854 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.162230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4448b6-e0ac-4943-aa2b-c0d8db8b5854 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.164712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 145/288] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:46 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:47.170751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4448b6-e0ac-4943-aa2b-c0d8db8b5854 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.265179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.301385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc39f6a-11ad-4c17-85d8-99cee17e59c8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.320093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4448b6-e0ac-4943-aa2b-c0d8db8b5854 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.352516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.353244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.353525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.353801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.355133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:47.355501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.357108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.371244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 144/289] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:47.371434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a436c-6be3-4336-8cdb-e66a8eaf7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.372294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a436c-6be3-4336-8cdb-e66a8eaf7d10 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.372651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a436c-6be3-4336-8cdb-e66a8eaf7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.372998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a436c-6be3-4336-8cdb-e66a8eaf7d10 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/users/bc53c89c781f4fe4a17a6340316f9044/roles/d2eaae75b1564805bb53d47f30537783` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.375694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a436c-6be3-4336-8cdb-e66a8eaf7d10 None admin] RBAC: Authorizing `identity:create_grant(project_id=7038bd1c4ee44ca29197ba920c0fde7b, user_id=bc53c89c781f4fe4a17a6340316f9044, role_id=d2eaae75b1564805bb53d47f30537783)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.376982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a436c-6be3-4336-8cdb-e66a8eaf7d10 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.377110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.438041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 146/290] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:24:47 2022] PUT /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/users/bc53c89c781f4fe4a17a6340316f9044/roles/d2eaae75b1564805bb53d47f30537783 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:24:47.446432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.515228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87539983-2b4d-4b9e-a2e5-b8b0bd55e179 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.562279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01954d09-b312-4159-9baa-743e4d87f755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.563593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954d09-b312-4159-9baa-743e4d87f755 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.564018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954d09-b312-4159-9baa-743e4d87f755 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.564433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01954d09-b312-4159-9baa-743e4d87f755 None admin] PATH_INFO: `/v3/users/d0018e3f234440fcbcb75b023b1d10a0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.565905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01954d09-b312-4159-9baa-743e4d87f755 None admin] RBAC: Authorizing `identity:get_user(user_id=d0018e3f234440fcbcb75b023b1d10a0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.567554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01954d09-b312-4159-9baa-743e4d87f755 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:47.569450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 145/291] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/users/d0018e3f234440fcbcb75b023b1d10a0 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:47.575485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a436c-6be3-4336-8cdb-e66a8eaf7d10 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:47.744850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a436c-6be3-4336-8cdb-e66a8eaf7d10 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:47.802317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6fc3-812b-40fe-8fd7-cf7bc4a6d073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:47.803300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6fc3-812b-40fe-8fd7-cf7bc4a6d073 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:47.803653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6fc3-812b-40fe-8fd7-cf7bc4a6d073 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:47.804045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e6fc3-812b-40fe-8fd7-cf7bc4a6d073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:47.817306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:47.914275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6fc3-812b-40fe-8fd7-cf7bc4a6d073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:47.916446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e6fc3-812b-40fe-8fd7-cf7bc4a6d073 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.062335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 147/292] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:48.068217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01954d09-b312-4159-9baa-743e4d87f755 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.206161 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01954d09-b312-4159-9baa-743e4d87f755 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.249497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.258010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0883b2c-2833-425b-8c84-8e455f37271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.262115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0883b2c-2833-425b-8c84-8e455f37271d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.262115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0883b2c-2833-425b-8c84-8e455f37271d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.262115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0883b2c-2833-425b-8c84-8e455f37271d None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.262115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0883b2c-2833-425b-8c84-8e455f37271d None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.266547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0883b2c-2833-425b-8c84-8e455f37271d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.266547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 146/293] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:48.270818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6fc3-812b-40fe-8fd7-cf7bc4a6d073 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:48.336531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:48.442645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e6fc3-812b-40fe-8fd7-cf7bc4a6d073 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:48.503635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f5cdaf-ed48-4aff-bf0f-d4f3a311fcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:48.504335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5cdaf-ed48-4aff-bf0f-d4f3a311fcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:48.504618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5cdaf-ed48-4aff-bf0f-d4f3a311fcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:48.504894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5cdaf-ed48-4aff-bf0f-d4f3a311fcf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:48.505741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5cdaf-ed48-4aff-bf0f-d4f3a311fcf6 None admin] RBAC: Adding query filter params (role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b, user.id=d0018e3f234440fcbcb75b023b1d10a0) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:48.506054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5cdaf-ed48-4aff-bf0f-d4f3a311fcf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:48.507553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f5cdaf-ed48-4aff-bf0f-d4f3a311fcf6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:48.516278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 148/294] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:48 2022] GET /identity/v3/role_assignments?user.id=d0018e3f234440fcbcb75b023b1d10a0&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:49.727647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a896af2-cd10-4288-bc57-01dedc72349e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.728225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a896af2-cd10-4288-bc57-01dedc72349e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.728225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a896af2-cd10-4288-bc57-01dedc72349e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.729720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 147/295] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:49.735584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faae9f-9ff0-430d-9cdc-6401d35085b6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:49.736097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faae9f-9ff0-430d-9cdc-6401d35085b6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:49.736178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8faae9f-9ff0-430d-9cdc-6401d35085b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:49.756362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b8faae9f-9ff0-430d-9cdc-6401d35085b6 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:49.757582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b8faae9f-9ff0-430d-9cdc-6401d35085b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:49.851248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 149/296] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:49.876202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a896af2-cd10-4288-bc57-01dedc72349e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.003341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a896af2-cd10-4288-bc57-01dedc72349e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.044666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f554f-35d6-47ed-8dd1-080a0a593650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.045868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f554f-35d6-47ed-8dd1-080a0a593650 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.046360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f554f-35d6-47ed-8dd1-080a0a593650 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.047010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f554f-35d6-47ed-8dd1-080a0a593650 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.050518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778e52-ac13-4504-bf17-2a627716a453 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.051151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778e52-ac13-4504-bf17-2a627716a453 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.051151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07778e52-ac13-4504-bf17-2a627716a453 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.052864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 150/297] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:24:50.058488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ee89-fb56-405b-ab86-27dd3d1daa60 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.058834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ee89-fb56-405b-ab86-27dd3d1daa60 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.059117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670ee89-fb56-405b-ab86-27dd3d1daa60 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.062168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 151/298] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:50.062168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8751b-0dec-4f72-a1f2-170ffc57d3f0 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.062168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8751b-0dec-4f72-a1f2-170ffc57d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.062168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8751b-0dec-4f72-a1f2-170ffc57d3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.065634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f554f-35d6-47ed-8dd1-080a0a593650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b49f554f-35d6-47ed-8dd1-080a0a593650 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:50.075436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:50.076427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:50.077288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 148/299] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:50.077986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1566-d3e0-4704-8864-59d137f7a2eb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.078369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1566-d3e0-4704-8864-59d137f7a2eb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.080044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f1566-d3e0-4704-8864-59d137f7a2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.084292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f7d8751b-0dec-4f72-a1f2-170ffc57d3f0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:50.085612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f7d8751b-0dec-4f72-a1f2-170ffc57d3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:50.104465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-147f1566-d3e0-4704-8864-59d137f7a2eb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:50.105779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-147f1566-d3e0-4704-8864-59d137f7a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:50.121047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.165335 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.178731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 152/300] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:50.178731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8751b-0dec-4f72-a1f2-170ffc57d3f0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.198770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 149/301] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:50.202429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f1566-d3e0-4704-8864-59d137f7a2eb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.327334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8751b-0dec-4f72-a1f2-170ffc57d3f0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.351650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f1566-d3e0-4704-8864-59d137f7a2eb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.382212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.383240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.383737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.384014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.384784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] RBAC: Adding query filter params (name=member) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:50.385082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.387305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.393294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbc47-d1ba-46e1-a80c-9399626091c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.394112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbc47-d1ba-46e1-a80c-9399626091c2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.394391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbc47-d1ba-46e1-a80c-9399626091c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.394696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddcbc47-d1ba-46e1-a80c-9399626091c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.397994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 153/302] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.404257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.413996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddcbc47-d1ba-46e1-a80c-9399626091c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8ddcbc47-d1ba-46e1-a80c-9399626091c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:50.429799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:50.430783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:50.431565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 150/303] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:50.434731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbc47-d1ba-46e1-a80c-9399626091c2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.447292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.485070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.546985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e28ea3-0631-4151-bde9-b9003b5e5c50 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.566482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddcbc47-d1ba-46e1-a80c-9399626091c2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.594051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe785b6-674c-4a0a-a73b-ebdf4a6c85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.595013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe785b6-674c-4a0a-a73b-ebdf4a6c85a3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.595299 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe785b6-674c-4a0a-a73b-ebdf4a6c85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.595574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe785b6-674c-4a0a-a73b-ebdf4a6c85a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.596974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe785b6-674c-4a0a-a73b-ebdf4a6c85a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.598464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe785b6-674c-4a0a-a73b-ebdf4a6c85a3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.600423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 154/304] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.604107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe785b6-674c-4a0a-a73b-ebdf4a6c85a3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.612612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff16327-cb2c-405a-8bed-345ece403f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.613511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16327-cb2c-405a-8bed-345ece403f34 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.613790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16327-cb2c-405a-8bed-345ece403f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.614059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff16327-cb2c-405a-8bed-345ece403f34 None admin] PATH_INFO: `/v3/users/660dff57619345b3b3f0bf33bcb65bd0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.615374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff16327-cb2c-405a-8bed-345ece403f34 None admin] RBAC: Authorizing `identity:get_user(user_id=660dff57619345b3b3f0bf33bcb65bd0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.616853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff16327-cb2c-405a-8bed-345ece403f34 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.625866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 151/305] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/users/660dff57619345b3b3f0bf33bcb65bd0 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.625866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff16327-cb2c-405a-8bed-345ece403f34 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.750079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.759275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff16327-cb2c-405a-8bed-345ece403f34 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.764681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe785b6-674c-4a0a-a73b-ebdf4a6c85a3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:50.772669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:50.807528 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.808542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.809576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.809576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.809951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:50.810133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.811578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.812672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783a14-4421-497a-9edb-34862fd925b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:50.813539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783a14-4421-497a-9edb-34862fd925b5 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.813828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783a14-4421-497a-9edb-34862fd925b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.814120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783a14-4421-497a-9edb-34862fd925b5 None admin] PATH_INFO: `/v3/groups` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.814852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa783a14-4421-497a-9edb-34862fd925b5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:50.816317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa783a14-4421-497a-9edb-34862fd925b5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:50.820965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 155/306] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:50.821808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.895825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 152/307] 10.222.0.60 () {60 vars in 1134 bytes} [Thu May 26 12:24:50 2022] POST /identity/v3/groups => generated 229 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:24:50.897664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389e88-b5ab-49fb-a8e2-76a23aeb0486 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:50.897947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389e88-b5ab-49fb-a8e2-76a23aeb0486 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:50.898290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66389e88-b5ab-49fb-a8e2-76a23aeb0486 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:50.901822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 153/308] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:50.907619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389e88-b5ab-49fb-a8e2-76a23aeb0486 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:50.982068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ebf97-b144-4b26-bdd8-945724748305 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.024010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3f128-4ef2-49dc-824f-88964d25f5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.025026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f128-4ef2-49dc-824f-88964d25f5ed None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.025353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f128-4ef2-49dc-824f-88964d25f5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.025633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3f128-4ef2-49dc-824f-88964d25f5ed None admin] PATH_INFO: `/v3/system/users/660dff57619345b3b3f0bf33bcb65bd0/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.027905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3f128-4ef2-49dc-824f-88964d25f5ed None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=660dff57619345b3b3f0bf33bcb65bd0, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.029281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3f128-4ef2-49dc-824f-88964d25f5ed None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.046034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66389e88-b5ab-49fb-a8e2-76a23aeb0486 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.086644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7d5c-cbda-4f17-9119-da4ebaf511a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.087446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7d5c-cbda-4f17-9119-da4ebaf511a6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.087724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7d5c-cbda-4f17-9119-da4ebaf511a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.087997 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ea7d5c-cbda-4f17-9119-da4ebaf511a6 None admin] PATH_INFO: `/v3/users/13b1307015cd40f7a9194872041738cd` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.108493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea7d5c-cbda-4f17-9119-da4ebaf511a6 None admin] RBAC: Authorizing `identity:get_user(user_id=13b1307015cd40f7a9194872041738cd)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.110059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ea7d5c-cbda-4f17-9119-da4ebaf511a6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.111217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 156/309] 10.222.0.60 () {58 vars in 1334 bytes} [Thu May 26 12:24:50 2022] PUT /identity/v3/system/users/660dff57619345b3b3f0bf33bcb65bd0/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:51.118799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 154/310] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:50 2022] GET /identity/v3/users/13b1307015cd40f7a9194872041738cd => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.119516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406b90c-b7df-4b90-a052-6c8551f55a35 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.119516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406b90c-b7df-4b90-a052-6c8551f55a35 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.119516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1406b90c-b7df-4b90-a052-6c8551f55a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.120786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7d5c-cbda-4f17-9119-da4ebaf511a6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.138962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-1406b90c-b7df-4b90-a052-6c8551f55a35 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:51.140253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-1406b90c-b7df-4b90-a052-6c8551f55a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:51.164699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.169380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.265084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 157/311] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:51.299213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406b90c-b7df-4b90-a052-6c8551f55a35 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.308527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ea7d5c-cbda-4f17-9119-da4ebaf511a6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.352098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.353131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.353668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.353990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.356235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] RBAC: Adding query filter params (role.id=d2eaae75b1564805bb53d47f30537783, user.id=13b1307015cd40f7a9194872041738cd, scope.system=all) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.356574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.358101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.363980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 155/312] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/role_assignments?user.id=13b1307015cd40f7a9194872041738cd&scope.system=all&role.id=d2eaae75b1564805bb53d47f30537783 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:51.447770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1406b90c-b7df-4b90-a052-6c8551f55a35 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.492465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17f472-8f69-4190-94d3-9380f484d2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.493292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f472-8f69-4190-94d3-9380f484d2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.493575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f472-8f69-4190-94d3-9380f484d2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.493851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17f472-8f69-4190-94d3-9380f484d2d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.507569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd17f472-8f69-4190-94d3-9380f484d2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-bd17f472-8f69-4190-94d3-9380f484d2d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:51.516943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:51.517896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:51.518698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 158/313] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:51.528093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.658317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.672648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fed1cb-a5a0-4859-af4d-e3685034c289 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.739056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.740489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.741152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.741802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.743332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:51.744072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.746912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.763749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 156/314] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.770559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17f472-8f69-4190-94d3-9380f484d2d5 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:51.785820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:51.891862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17f472-8f69-4190-94d3-9380f484d2d5 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:51.930500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd9c1-c747-47df-a819-836d91813ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:51.931674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd9c1-c747-47df-a819-836d91813ede None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:51.932795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd9c1-c747-47df-a819-836d91813ede None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:51.933308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecdd9c1-c747-47df-a819-836d91813ede None admin] PATH_INFO: `/v3/users/bc53c89c781f4fe4a17a6340316f9044` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:51.942363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdd9c1-c747-47df-a819-836d91813ede None admin] RBAC: Authorizing `identity:get_user(user_id=bc53c89c781f4fe4a17a6340316f9044)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:51.943885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecdd9c1-c747-47df-a819-836d91813ede None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:51.945949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 159/315] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/users/bc53c89c781f4fe4a17a6340316f9044 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:51.951851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.061437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ba69f-064f-425b-8b9e-b134361062d2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.103593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebd41d-f105-4b45-9f55-c62aa8e44cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.104326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd41d-f105-4b45-9f55-c62aa8e44cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.104756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd41d-f105-4b45-9f55-c62aa8e44cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.105079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ebd41d-f105-4b45-9f55-c62aa8e44cf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.129248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.184850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebd41d-f105-4b45-9f55-c62aa8e44cf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.186679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ebd41d-f105-4b45-9f55-c62aa8e44cf8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.299549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 157/316] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:52.306035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd9c1-c747-47df-a819-836d91813ede None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.426229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.452150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecdd9c1-c747-47df-a819-836d91813ede None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.498251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c443b7b-87a5-4668-b8e3-592688e098ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.499671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443b7b-87a5-4668-b8e3-592688e098ab None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.500122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443b7b-87a5-4668-b8e3-592688e098ab None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.500570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c443b7b-87a5-4668-b8e3-592688e098ab None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.502466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c443b7b-87a5-4668-b8e3-592688e098ab None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.504945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c443b7b-87a5-4668-b8e3-592688e098ab None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.507957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 160/317] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:52.518268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebd41d-f105-4b45-9f55-c62aa8e44cf8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:52.592535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:52.642075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ebd41d-f105-4b45-9f55-c62aa8e44cf8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:52.678680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5824-7983-40a4-9b73-5579c485066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:52.679353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5824-7983-40a4-9b73-5579c485066b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:52.679634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5824-7983-40a4-9b73-5579c485066b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:52.679910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5824-7983-40a4-9b73-5579c485066b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:52.680742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf5824-7983-40a4-9b73-5579c485066b None admin] RBAC: Adding query filter params (role.id=d2eaae75b1564805bb53d47f30537783, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b, user.id=bc53c89c781f4fe4a17a6340316f9044) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:52.681051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf5824-7983-40a4-9b73-5579c485066b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:52.682594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf5824-7983-40a4-9b73-5579c485066b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:52.693122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 158/318] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:24:52 2022] GET /identity/v3/role_assignments?user.id=bc53c89c781f4fe4a17a6340316f9044&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=d2eaae75b1564805bb53d47f30537783 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:53.455671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba948-3ee0-45b1-ad42-3456e626f0d3 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.456180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba948-3ee0-45b1-ad42-3456e626f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.456254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dba948-3ee0-45b1-ad42-3456e626f0d3 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.457575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 161/319] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:53.463103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4e0b-6de9-4d88-95e2-191cd04563e4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.463625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4e0b-6de9-4d88-95e2-191cd04563e4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.463896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd4e0b-6de9-4d88-95e2-191cd04563e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.481029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6efd4e0b-6de9-4d88-95e2-191cd04563e4 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:53.482201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6efd4e0b-6de9-4d88-95e2-191cd04563e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:53.552925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 159/320] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:53.573703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929e2b-af3e-4b82-a9ed-6642910d85ba None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.573981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929e2b-af3e-4b82-a9ed-6642910d85ba None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.574445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46929e2b-af3e-4b82-a9ed-6642910d85ba None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.576014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4e0b-6de9-4d88-95e2-191cd04563e4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.576130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 162/321] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:53.581388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239098e-62de-47d0-9dce-8fe86c21a554 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.581746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239098e-62de-47d0-9dce-8fe86c21a554 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.582093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239098e-62de-47d0-9dce-8fe86c21a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.600444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4239098e-62de-47d0-9dce-8fe86c21a554 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:53.601628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4239098e-62de-47d0-9dce-8fe86c21a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:53.625781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.676789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 163/322] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:53.698663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd4e0b-6de9-4d88-95e2-191cd04563e4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.700936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239098e-62de-47d0-9dce-8fe86c21a554 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.746298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a9d1-d350-40e8-814d-485fb4c6bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.747133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a9d1-d350-40e8-814d-485fb4c6bcab None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.747413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a9d1-d350-40e8-814d-485fb4c6bcab None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.747686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271a9d1-d350-40e8-814d-485fb4c6bcab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.749236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a9d1-d350-40e8-814d-485fb4c6bcab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.750788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271a9d1-d350-40e8-814d-485fb4c6bcab None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.752537 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 160/323] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:53.757887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a9d1-d350-40e8-814d-485fb4c6bcab None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.792503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.818860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239098e-62de-47d0-9dce-8fe86c21a554 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.856094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ba27-c3af-4886-b3bf-da74a45215c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.856521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ba27-c3af-4886-b3bf-da74a45215c7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.856828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ba27-c3af-4886-b3bf-da74a45215c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.857073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f992ba27-c3af-4886-b3bf-da74a45215c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.866319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271a9d1-d350-40e8-814d-485fb4c6bcab None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.867690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f992ba27-c3af-4886-b3bf-da74a45215c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-f992ba27-c3af-4886-b3bf-da74a45215c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:53.876301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:53.877237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:53.878048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 164/324] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:53.883156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ba27-c3af-4886-b3bf-da74a45215c7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:53.885035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:53.907438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80dc26-6a8c-4ba7-b74b-b96afe067cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:53.908214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dc26-6a8c-4ba7-b74b-b96afe067cb9 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.908499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dc26-6a8c-4ba7-b74b-b96afe067cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.908865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dc26-6a8c-4ba7-b74b-b96afe067cb9 None admin] PATH_INFO: `/v3/groups` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.909567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80dc26-6a8c-4ba7-b74b-b96afe067cb9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:53.911558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80dc26-6a8c-4ba7-b74b-b96afe067cb9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:53.994570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 161/325] 10.222.0.60 () {60 vars in 1134 bytes} [Thu May 26 12:24:53 2022] POST /identity/v3/groups => generated 226 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:24:53.994570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62faf9-fcdb-4c97-85be-42646deb633f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.994570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62faf9-fcdb-4c97-85be-42646deb633f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.994570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62faf9-fcdb-4c97-85be-42646deb633f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:53.994570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 162/326] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:53.996254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f992ba27-c3af-4886-b3bf-da74a45215c7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:53.996353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad915492-bc6a-479f-8a6d-7b1dca4d7d8c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:53.996353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad915492-bc6a-479f-8a6d-7b1dca4d7d8c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:53.996353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad915492-bc6a-479f-8a6d-7b1dca4d7d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.023937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ad915492-bc6a-479f-8a6d-7b1dca4d7d8c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:54.025432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ad915492-bc6a-479f-8a6d-7b1dca4d7d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:54.029870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.030582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.030865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.031135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.031895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] RBAC: Adding query filter params (name=member) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.032198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.033615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.035476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.044906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 165/327] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:54.050364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.122072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 163/328] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:54.134777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad915492-bc6a-479f-8a6d-7b1dca4d7d8c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.178056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a9b9f-1f5e-4167-9c23-d3ed14b5fc78 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.226704 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389508f7-d553-472f-acfb-7a68d51403e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.227604 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389508f7-d553-472f-acfb-7a68d51403e9 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.228324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389508f7-d553-472f-acfb-7a68d51403e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.228603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389508f7-d553-472f-acfb-7a68d51403e9 None admin] PATH_INFO: `/v3/users/660dff57619345b3b3f0bf33bcb65bd0` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.230449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389508f7-d553-472f-acfb-7a68d51403e9 None admin] RBAC: Authorizing `identity:get_user(user_id=660dff57619345b3b3f0bf33bcb65bd0)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.232883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389508f7-d553-472f-acfb-7a68d51403e9 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.235606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 166/329] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/users/660dff57619345b3b3f0bf33bcb65bd0 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:54.240505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389508f7-d553-472f-acfb-7a68d51403e9 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.266637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad915492-bc6a-479f-8a6d-7b1dca4d7d8c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.269059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.317610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55574f18-cf49-406e-b4dd-dfcdefbf7e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.318424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55574f18-cf49-406e-b4dd-dfcdefbf7e0b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.318806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55574f18-cf49-406e-b4dd-dfcdefbf7e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.319082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55574f18-cf49-406e-b4dd-dfcdefbf7e0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.326355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.331693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55574f18-cf49-406e-b4dd-dfcdefbf7e0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-55574f18-cf49-406e-b4dd-dfcdefbf7e0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:54.341207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:54.342133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:54.342960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 164/330] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:24:54.348451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55574f18-cf49-406e-b4dd-dfcdefbf7e0b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.378891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389508f7-d553-472f-acfb-7a68d51403e9 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.426115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.426827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.427092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.427365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.428199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] RBAC: Adding query filter params (role.id=b6f4cd580a914b0aa8c3a237d63e5350, user.id=660dff57619345b3b3f0bf33bcb65bd0, scope.system=all) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.428512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.429958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.447514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 167/331] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/role_assignments?user.id=660dff57619345b3b3f0bf33bcb65bd0&scope.system=all&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.476471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55574f18-cf49-406e-b4dd-dfcdefbf7e0b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.520228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.520932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.521212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.521487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.522556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:54.522869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.524333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.537577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 165/332] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:54.541271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.662975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8227f5-7666-4af9-a134-1f030bdda420 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.688078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.702471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4dfd8-5ae1-46b6-bf7f-4e098d6c64d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.703660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4dfd8-5ae1-46b6-bf7f-4e098d6c64d9 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.703944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4dfd8-5ae1-46b6-bf7f-4e098d6c64d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.704221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4dfd8-5ae1-46b6-bf7f-4e098d6c64d9 None admin] PATH_INFO: `/v3/users/13b1307015cd40f7a9194872041738cd` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.705748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4dfd8-5ae1-46b6-bf7f-4e098d6c64d9 None admin] RBAC: Authorizing `identity:get_user(user_id=13b1307015cd40f7a9194872041738cd)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.707271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4dfd8-5ae1-46b6-bf7f-4e098d6c64d9 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.710011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 168/333] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:24:54 2022] GET /identity/v3/users/13b1307015cd40f7a9194872041738cd => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:54.715721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:54.753130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:54.843071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312fa37-e21e-4929-8968-eac034a4b114 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:54.883212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f2203d-83c6-4ecf-9b2b-bd517f92c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:54.884096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2203d-83c6-4ecf-9b2b-bd517f92c416 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:54.884380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2203d-83c6-4ecf-9b2b-bd517f92c416 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:54.884658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f2203d-83c6-4ecf-9b2b-bd517f92c416 None admin] PATH_INFO: `/v3/system/users/13b1307015cd40f7a9194872041738cd/roles/d2eaae75b1564805bb53d47f30537783` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:54.887296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2203d-83c6-4ecf-9b2b-bd517f92c416 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=13b1307015cd40f7a9194872041738cd, role_id=d2eaae75b1564805bb53d47f30537783)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:54.888829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f2203d-83c6-4ecf-9b2b-bd517f92c416 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:54.968709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 166/334] 10.222.0.60 () {58 vars in 1334 bytes} [Thu May 26 12:24:54 2022] PUT /identity/v3/system/users/13b1307015cd40f7a9194872041738cd/roles/d2eaae75b1564805bb53d47f30537783 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:24:56.885996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad83a-71f1-44f2-9a78-42319ff55438 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.886878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad83a-71f1-44f2-9a78-42319ff55438 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.887331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ad83a-71f1-44f2-9a78-42319ff55438 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.889388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 169/335] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:56.896946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d789-e773-498d-bd63-38a704df9d95 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:56.897821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d789-e773-498d-bd63-38a704df9d95 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:56.898246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947d789-e773-498d-bd63-38a704df9d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:56.921937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e947d789-e773-498d-bd63-38a704df9d95 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:56.923597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e947d789-e773-498d-bd63-38a704df9d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:57.017481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 167/336] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:24:57.054011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ad83a-71f1-44f2-9a78-42319ff55438 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:57.227401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ad83a-71f1-44f2-9a78-42319ff55438 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:57.294063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413be74-874d-4a59-953a-2a0d89aace0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:57.295442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413be74-874d-4a59-953a-2a0d89aace0c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.295730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413be74-874d-4a59-953a-2a0d89aace0c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.296147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413be74-874d-4a59-953a-2a0d89aace0c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.319580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413be74-874d-4a59-953a-2a0d89aace0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-0413be74-874d-4a59-953a-2a0d89aace0c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:57.328478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:57.330125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:57.331174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:57.333272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 170/337] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:24:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:57.339953 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947d789-e773-498d-bd63-38a704df9d95 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:57.367205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:57.375016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d993df-8c6a-454f-8dd8-620c9b88a7df None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.375333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d993df-8c6a-454f-8dd8-620c9b88a7df None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.375576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d993df-8c6a-454f-8dd8-620c9b88a7df None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.377164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 171/338] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:57.383372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff52e47-fd7c-44a3-8eb9-0e8ff331a46b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.383663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff52e47-fd7c-44a3-8eb9-0e8ff331a46b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.383944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff52e47-fd7c-44a3-8eb9-0e8ff331a46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.417779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-fff52e47-fd7c-44a3-8eb9-0e8ff331a46b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:57.420664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fff52e47-fd7c-44a3-8eb9-0e8ff331a46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:57.517204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947d789-e773-498d-bd63-38a704df9d95 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:57.525799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:57.567590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:57.568816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.569293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.570021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.571021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:57.572081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:57.574258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:57.585884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 168/339] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:24:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:57.591418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:57.592078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 172/340] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:57.663061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff52e47-fd7c-44a3-8eb9-0e8ff331a46b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:57.718644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:57.761176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639f203-a580-4cfd-ae46-0a282ea729cb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:57.828126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3a6c0-1047-4d08-8bba-c37ca8e1cf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:57.829125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3a6c0-1047-4d08-8bba-c37ca8e1cf14 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.829628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3a6c0-1047-4d08-8bba-c37ca8e1cf14 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.830285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3a6c0-1047-4d08-8bba-c37ca8e1cf14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.869988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff52e47-fd7c-44a3-8eb9-0e8ff331a46b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:57.932170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4a5b-6173-4bf2-9527-d925db39fab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:57.933466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4a5b-6173-4bf2-9527-d925db39fab9 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:57.933909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4a5b-6173-4bf2-9527-d925db39fab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:57.934341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f4a5b-6173-4bf2-9527-d925db39fab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:57.956836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f4a5b-6173-4bf2-9527-d925db39fab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:57.967046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3a6c0-1047-4d08-8bba-c37ca8e1cf14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-cc5f4a5b-6173-4bf2-9527-d925db39fab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:57.968957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:57.969806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:24:57.970597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 173/341] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:57.972040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3a6c0-1047-4d08-8bba-c37ca8e1cf14 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:57.978077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4a5b-6173-4bf2-9527-d925db39fab9 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.085015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.104216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.136597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 169/342] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:58.142298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3a6c0-1047-4d08-8bba-c37ca8e1cf14 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.237045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f4a5b-6173-4bf2-9527-d925db39fab9 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.316291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c5164-5f8b-482e-9567-217efc58434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.317163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5164-5f8b-482e-9567-217efc58434a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.317465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5164-5f8b-482e-9567-217efc58434a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.317798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c5164-5f8b-482e-9567-217efc58434a None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.318583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c5164-5f8b-482e-9567-217efc58434a None admin] RBAC: Adding query filter params (name=member) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:58.319052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c5164-5f8b-482e-9567-217efc58434a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.320692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c5164-5f8b-482e-9567-217efc58434a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.331929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 174/343] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:58.333572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fbf73-5096-45cd-abb7-bd8c2177e102 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.333872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fbf73-5096-45cd-abb7-bd8c2177e102 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.334148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fbf73-5096-45cd-abb7-bd8c2177e102 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.340160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 175/344] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:58.341038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fbf73-5096-45cd-abb7-bd8c2177e102 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.342311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3a6c0-1047-4d08-8bba-c37ca8e1cf14 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.397104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c4fe8-6e16-4fcd-9a65-24fa1438b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.398049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4fe8-6e16-4fcd-9a65-24fa1438b8af None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.398329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4fe8-6e16-4fcd-9a65-24fa1438b8af None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.399418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c4fe8-6e16-4fcd-9a65-24fa1438b8af None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.400989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c4fe8-6e16-4fcd-9a65-24fa1438b8af None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.402739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c4fe8-6e16-4fcd-9a65-24fa1438b8af None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.404844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 170/345] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:24:58.406106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23b55-d3ca-49ba-9a26-9175a133b6e5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.406387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23b55-d3ca-49ba-9a26-9175a133b6e5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.406718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa23b55-d3ca-49ba-9a26-9175a133b6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.426191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cfa23b55-d3ca-49ba-9a26-9175a133b6e5 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:58.427429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cfa23b55-d3ca-49ba-9a26-9175a133b6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:58.482990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.506655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 171/346] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:58.507625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa23b55-d3ca-49ba-9a26-9175a133b6e5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.529603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fbf73-5096-45cd-abb7-bd8c2177e102 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.531891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.585523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8607a-71fc-442d-9e24-8e16a767442d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.586636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8607a-71fc-442d-9e24-8e16a767442d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.587078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8607a-71fc-442d-9e24-8e16a767442d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8607a-71fc-442d-9e24-8e16a767442d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.658368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa23b55-d3ca-49ba-9a26-9175a133b6e5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.705653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8607a-71fc-442d-9e24-8e16a767442d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.707807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8607a-71fc-442d-9e24-8e16a767442d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.716840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d326b021-0cfa-428f-b1f9-cc029bd568ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.717750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326b021-0cfa-428f-b1f9-cc029bd568ba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.718030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326b021-0cfa-428f-b1f9-cc029bd568ba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.718304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d326b021-0cfa-428f-b1f9-cc029bd568ba None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.727208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326b021-0cfa-428f-b1f9-cc029bd568ba None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:58.731702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d326b021-0cfa-428f-b1f9-cc029bd568ba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:58.732062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 172/347] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:58.733908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8e20-28be-4d78-8bd9-f48c9c667721 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.734195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8e20-28be-4d78-8bd9-f48c9c667721 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.734469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf8e20-28be-4d78-8bd9-f48c9c667721 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.736463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 173/348] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:58.741747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf8e20-28be-4d78-8bd9-f48c9c667721 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.811472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.866083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 176/349] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:24:58.867324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8607a-71fc-442d-9e24-8e16a767442d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:58.870727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:58.885765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf8e20-28be-4d78-8bd9-f48c9c667721 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:58.945124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c27ee-57ee-4d5a-b2bf-7b8614ec6248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:58.948362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c27ee-57ee-4d5a-b2bf-7b8614ec6248 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.949220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c27ee-57ee-4d5a-b2bf-7b8614ec6248 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.950001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c27ee-57ee-4d5a-b2bf-7b8614ec6248 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:58.970240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c27ee-57ee-4d5a-b2bf-7b8614ec6248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3f4c27ee-57ee-4d5a-b2bf-7b8614ec6248 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:58.987827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:58.989683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:58.991356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 174/350] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:58.992697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daee31-f0e5-4028-97b4-87f164576905 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:58.992697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daee31-f0e5-4028-97b4-87f164576905 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:58.992697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daee31-f0e5-4028-97b4-87f164576905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.001636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8607a-71fc-442d-9e24-8e16a767442d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.017515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-65daee31-f0e5-4028-97b4-87f164576905 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:59.019051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-65daee31-f0e5-4028-97b4-87f164576905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:59.045645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.046693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.047174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.047732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.048585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] RBAC: Adding query filter params (group.id=12b509b3bf2e41968403b8a44b5f7f8f, role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=3c571faec99847838c665f0fa1909346) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.048899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.050372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.062561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 177/351] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:24:58 2022] GET /identity/v3/role_assignments?group.id=12b509b3bf2e41968403b8a44b5f7f8f&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.062561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.126984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 175/352] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:59.129401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d08700-0775-4807-a5f2-9641654e1a53 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.129687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d08700-0775-4807-a5f2-9641654e1a53 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.129985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d08700-0775-4807-a5f2-9641654e1a53 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.131872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 176/353] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:59.134015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d08700-0775-4807-a5f2-9641654e1a53 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.192170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.207837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.255313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ed94-eb10-444e-ad49-4ae74004233a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.308632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bd2c5-b79d-41f2-9610-4d72f9e25507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.308632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd2c5-b79d-41f2-9610-4d72f9e25507 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.308924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd2c5-b79d-41f2-9610-4d72f9e25507 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.309191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bd2c5-b79d-41f2-9610-4d72f9e25507 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.311273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd2c5-b79d-41f2-9610-4d72f9e25507 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.315291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bd2c5-b79d-41f2-9610-4d72f9e25507 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.318200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 178/354] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.322695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0ff0-25a0-440a-b55b-9105f6a299ec None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.322695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0ff0-25a0-440a-b55b-9105f6a299ec None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.322695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd0ff0-25a0-440a-b55b-9105f6a299ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.331363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d08700-0775-4807-a5f2-9641654e1a53 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.343403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e2fd0ff0-25a0-440a-b55b-9105f6a299ec None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:24:59.344614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e2fd0ff0-25a0-440a-b55b-9105f6a299ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:24:59.402727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.403422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.404501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.404501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.404766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:24:59.405031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.406542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.425713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 177/355] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.426582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.427226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 179/356] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:24:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:24:59.427956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0ff0-25a0-440a-b55b-9105f6a299ec None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.536693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.595545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd0ff0-25a0-440a-b55b-9105f6a299ec None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.598747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.608572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfe2f9-14ae-4caa-b2f4-45a046b77e05 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.648063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4e08b-fa4c-41d8-97c5-97dd07f5997f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.649108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e08b-fa4c-41d8-97c5-97dd07f5997f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.649388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e08b-fa4c-41d8-97c5-97dd07f5997f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.649656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e08b-fa4c-41d8-97c5-97dd07f5997f None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.651702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4e08b-fa4c-41d8-97c5-97dd07f5997f None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.654804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4e08b-fa4c-41d8-97c5-97dd07f5997f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.655334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 180/357] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:24:59.656374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4e08b-fa4c-41d8-97c5-97dd07f5997f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.661096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5822-a29f-43a2-bf12-a5bd49d39b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.661911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5822-a29f-43a2-bf12-a5bd49d39b5d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.662418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5822-a29f-43a2-bf12-a5bd49d39b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.663007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e5822-a29f-43a2-bf12-a5bd49d39b5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.677767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e5822-a29f-43a2-bf12-a5bd49d39b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bb5e5822-a29f-43a2-bf12-a5bd49d39b5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:59.687048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.687993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:59.688800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 178/358] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.689449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5822-a29f-43a2-bf12-a5bd49d39b5d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.787875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4e08b-fa4c-41d8-97c5-97dd07f5997f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.830584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:24:59.842323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478d796-7fe7-4faa-a15e-cc6352c82f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.843383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d796-7fe7-4faa-a15e-cc6352c82f21 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.843872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d796-7fe7-4faa-a15e-cc6352c82f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.844334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478d796-7fe7-4faa-a15e-cc6352c82f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.844455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e5822-a29f-43a2-bf12-a5bd49d39b5d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:24:59.887790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452d85f-f16c-4c24-b3e0-5b38c103912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:24:59.888614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d85f-f16c-4c24-b3e0-5b38c103912c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.888899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d85f-f16c-4c24-b3e0-5b38c103912c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.889176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452d85f-f16c-4c24-b3e0-5b38c103912c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.903580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452d85f-f16c-4c24-b3e0-5b38c103912c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9452d85f-f16c-4c24-b3e0-5b38c103912c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:24:59.916293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:24:59.917693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 12:24:59.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:24:59.921024 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 179/359] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:24:59.923652 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc60e-15a0-4d38-a0de-cc48a31f44fe None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:24:59.924260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc60e-15a0-4d38-a0de-cc48a31f44fe None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:24:59.924548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eafc60e-15a0-4d38-a0de-cc48a31f44fe None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:24:59.925972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 180/360] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:24:59.926744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc60e-15a0-4d38-a0de-cc48a31f44fe None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:24:59.941664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478d796-7fe7-4faa-a15e-cc6352c82f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:24:59.943047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478d796-7fe7-4faa-a15e-cc6352c82f21 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:24:59.951823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.067534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eafc60e-15a0-4d38-a0de-cc48a31f44fe None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.081792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 181/361] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:00.082681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478d796-7fe7-4faa-a15e-cc6352c82f21 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.111586 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.112299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.112581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.112860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.113706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] RBAC: Adding query filter params (group.id=12b509b3bf2e41968403b8a44b5f7f8f, role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=3c571faec99847838c665f0fa1909346) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.114021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.115594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.121744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 181/362] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:24:59 2022] GET /identity/v3/role_assignments?group.id=12b509b3bf2e41968403b8a44b5f7f8f&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.122881 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.124758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.228020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478d796-7fe7-4faa-a15e-cc6352c82f21 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.233090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.260967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2483e7f-a931-4dea-8fe3-2cf668d4aa4d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.285721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1feb8-c52a-4291-9d69-e94e8e860979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.286572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1feb8-c52a-4291-9d69-e94e8e860979 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.286869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1feb8-c52a-4291-9d69-e94e8e860979 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.287150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1feb8-c52a-4291-9d69-e94e8e860979 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.287927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1feb8-c52a-4291-9d69-e94e8e860979 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.288235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1feb8-c52a-4291-9d69-e94e8e860979 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.290236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1feb8-c52a-4291-9d69-e94e8e860979 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.302772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 182/363] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.304674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fb443-183e-4cb4-b53b-ffaae9f47dd3 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.304974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fb443-183e-4cb4-b53b-ffaae9f47dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.305250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fb443-183e-4cb4-b53b-ffaae9f47dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.322059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.323337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.323842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.324372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.325373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:00.325944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.327649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.328438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-2b1fb443-183e-4cb4-b53b-ffaae9f47dd3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:00.330299 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2b1fb443-183e-4cb4-b53b-ffaae9f47dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:00.340382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 182/364] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.342055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.420834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 183/365] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:00.421790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fb443-183e-4cb4-b53b-ffaae9f47dd3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.449384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.483502 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e28453-6827-46df-8e5b-472213306c57 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.536016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c5c51-7f28-475e-be62-0f1bb2509433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.536893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5c51-7f28-475e-be62-0f1bb2509433 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.537170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5c51-7f28-475e-be62-0f1bb2509433 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.537440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c5c51-7f28-475e-be62-0f1bb2509433 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.539368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c5c51-7f28-475e-be62-0f1bb2509433 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.541811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722c5c51-7f28-475e-be62-0f1bb2509433 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.545074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 183/366] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.546507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c5c51-7f28-475e-be62-0f1bb2509433 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.565623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.568421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fb443-183e-4cb4-b53b-ffaae9f47dd3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.619848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f85a5-f2a9-499f-a305-b7dc35188972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.620589 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f85a5-f2a9-499f-a305-b7dc35188972 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.621934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f85a5-f2a9-499f-a305-b7dc35188972 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.622219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f85a5-f2a9-499f-a305-b7dc35188972 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.706368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722c5c51-7f28-475e-be62-0f1bb2509433 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.707801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f85a5-f2a9-499f-a305-b7dc35188972 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.709372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f85a5-f2a9-499f-a305-b7dc35188972 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.750370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.756490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aebffe-40b4-4ea7-a7ed-6321def9acca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.757409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aebffe-40b4-4ea7-a7ed-6321def9acca None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.757691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aebffe-40b4-4ea7-a7ed-6321def9acca None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.759082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aebffe-40b4-4ea7-a7ed-6321def9acca None admin] PATH_INFO: `/v3/users/13b1307015cd40f7a9194872041738cd` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.759413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aebffe-40b4-4ea7-a7ed-6321def9acca None admin] RBAC: Authorizing `identity:get_user(user_id=13b1307015cd40f7a9194872041738cd)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:00.760968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aebffe-40b4-4ea7-a7ed-6321def9acca None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:00.765844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 184/367] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/users/13b1307015cd40f7a9194872041738cd => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:00.766660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aebffe-40b4-4ea7-a7ed-6321def9acca None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.863675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 184/368] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:00.864619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f85a5-f2a9-499f-a305-b7dc35188972 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:00.866731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:00.894825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aebffe-40b4-4ea7-a7ed-6321def9acca None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:00.942345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be385ea-ca69-4e3e-8682-53d938222279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:00.943294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be385ea-ca69-4e3e-8682-53d938222279 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:00.943576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be385ea-ca69-4e3e-8682-53d938222279 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:00.943849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be385ea-ca69-4e3e-8682-53d938222279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:00.958010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be385ea-ca69-4e3e-8682-53d938222279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9be385ea-ca69-4e3e-8682-53d938222279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:00.970323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:00.972607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 185/369] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:00.974558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be385ea-ca69-4e3e-8682-53d938222279 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.002411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f85a5-f2a9-499f-a305-b7dc35188972 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.036001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.058506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53e6bb-e89b-4d14-b0ac-7de8bd353cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.059437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53e6bb-e89b-4d14-b0ac-7de8bd353cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.059711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53e6bb-e89b-4d14-b0ac-7de8bd353cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.059992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53e6bb-e89b-4d14-b0ac-7de8bd353cc5 None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.061252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53e6bb-e89b-4d14-b0ac-7de8bd353cc5 None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.065369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53e6bb-e89b-4d14-b0ac-7de8bd353cc5 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.066563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 185/370] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.067415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53e6bb-e89b-4d14-b0ac-7de8bd353cc5 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.121194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be385ea-ca69-4e3e-8682-53d938222279 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.173408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.174328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.174654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.174933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.175777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] RBAC: Adding query filter params (role.id=d2eaae75b1564805bb53d47f30537783, user.id=13b1307015cd40f7a9194872041738cd, scope.system=all) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.176087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.177528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.188147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.197892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 186/371] 10.222.0.60 () {56 vars in 1308 bytes} [Thu May 26 12:25:00 2022] GET /identity/v3/role_assignments?user.id=13b1307015cd40f7a9194872041738cd&scope.system=all&role.id=d2eaae75b1564805bb53d47f30537783 => generated 510 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.199325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.215160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53e6bb-e89b-4d14-b0ac-7de8bd353cc5 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.290315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af9bc-8be6-4988-b01b-66fbed440ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.291886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af9bc-8be6-4988-b01b-66fbed440ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.296713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af9bc-8be6-4988-b01b-66fbed440ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.296713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384af9bc-8be6-4988-b01b-66fbed440ae7 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.296713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384af9bc-8be6-4988-b01b-66fbed440ae7 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.297240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384af9bc-8be6-4988-b01b-66fbed440ae7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.300985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 186/372] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.303054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af9bc-8be6-4988-b01b-66fbed440ae7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.392664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0de24-2d28-4d0f-825d-a5558350b711 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.440411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.441020 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.441302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.441577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.442340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.442685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.444159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.455133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 187/373] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.456119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.483749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.528344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.546441 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384af9bc-8be6-4988-b01b-66fbed440ae7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.575869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99778f93-b4d2-4f4a-92b3-e6876eb35277 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.588739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.589681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.590114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.590576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.591726 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] RBAC: Adding query filter params (group.id=12b509b3bf2e41968403b8a44b5f7f8f, role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.592212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.593958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.604836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 187/374] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/role_assignments?group.id=12b509b3bf2e41968403b8a44b5f7f8f&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 260 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.606114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.623334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7a37e-cc09-4843-b9d4-5002c5f90d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.624295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7a37e-cc09-4843-b9d4-5002c5f90d28 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.624576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7a37e-cc09-4843-b9d4-5002c5f90d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.624851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7a37e-cc09-4843-b9d4-5002c5f90d28 None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.630615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7a37e-cc09-4843-b9d4-5002c5f90d28 None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.630615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7a37e-cc09-4843-b9d4-5002c5f90d28 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.633191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 188/375] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:01.637879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7a37e-cc09-4843-b9d4-5002c5f90d28 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:01.758270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7a37e-cc09-4843-b9d4-5002c5f90d28 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.789820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.799718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d45f99-4908-44a7-937a-a9fea10b1c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.802007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45f99-4908-44a7-937a-a9fea10b1c50 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.802007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45f99-4908-44a7-937a-a9fea10b1c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.802007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d45f99-4908-44a7-937a-a9fea10b1c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.802007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45f99-4908-44a7-937a-a9fea10b1c50 None admin] RBAC: Adding query filter params (group.id=12b509b3bf2e41968403b8a44b5f7f8f, role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:01.802332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45f99-4908-44a7-937a-a9fea10b1c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.803705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d45f99-4908-44a7-937a-a9fea10b1c50 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:01.807166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92019a35-c53e-435c-9667-3c4ea70c1fb0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:01.820919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 189/376] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/role_assignments?group.id=12b509b3bf2e41968403b8a44b5f7f8f&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:01.854992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:01.871298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de60d-5a96-4620-b65b-76b1594cec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:01.872319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de60d-5a96-4620-b65b-76b1594cec4b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.872760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de60d-5a96-4620-b65b-76b1594cec4b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.873181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6de60d-5a96-4620-b65b-76b1594cec4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.886321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e7663-37fe-489a-b981-6b456dbc362b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.886630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e7663-37fe-489a-b981-6b456dbc362b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.886908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e7663-37fe-489a-b981-6b456dbc362b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.889676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 190/377] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:01.894222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f8c2-5edf-47e2-b621-d6b6c841a12c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:01.894504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f8c2-5edf-47e2-b621-d6b6c841a12c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:01.894850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3f8c2-5edf-47e2-b621-d6b6c841a12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:01.933768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c2c3f8c2-5edf-47e2-b621-d6b6c841a12c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:01.936721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c2c3f8c2-5edf-47e2-b621-d6b6c841a12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:01.996136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6de60d-5a96-4620-b65b-76b1594cec4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:01.997746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6de60d-5a96-4620-b65b-76b1594cec4b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.114941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 191/378] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:02.140212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 188/379] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:02.146410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f8c2-5edf-47e2-b621-d6b6c841a12c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.161979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de60d-5a96-4620-b65b-76b1594cec4b None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.207916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.344042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3f8c2-5edf-47e2-b621-d6b6c841a12c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.393036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.399396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6de60d-5a96-4620-b65b-76b1594cec4b None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.424568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0cdea-1228-4135-9ab7-dcebf9244bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.425757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0cdea-1228-4135-9ab7-dcebf9244bfb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.426225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0cdea-1228-4135-9ab7-dcebf9244bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.426500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0cdea-1228-4135-9ab7-dcebf9244bfb None admin] PATH_INFO: `/v3/projects/d4d4adba733e41f4aa7039514b116efa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.433316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0cdea-1228-4135-9ab7-dcebf9244bfb None admin] RBAC: Authorizing `identity:get_project(project_id=d4d4adba733e41f4aa7039514b116efa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.436780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0cdea-1228-4135-9ab7-dcebf9244bfb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.442631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 192/380] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/projects/d4d4adba733e41f4aa7039514b116efa => generated 344 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:02.446280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0cdea-1228-4135-9ab7-dcebf9244bfb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.482694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b93b-dcc4-4bb2-95f3-1d5b79d45d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.483929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b93b-dcc4-4bb2-95f3-1d5b79d45d7f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.484408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b93b-dcc4-4bb2-95f3-1d5b79d45d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.484874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543b93b-dcc4-4bb2-95f3-1d5b79d45d7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.511968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543b93b-dcc4-4bb2-95f3-1d5b79d45d7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c543b93b-dcc4-4bb2-95f3-1d5b79d45d7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:02.522910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:02.523873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:02.524680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:02.533853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 189/381] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:02.545848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b93b-dcc4-4bb2-95f3-1d5b79d45d7f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.614246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0cdea-1228-4135-9ab7-dcebf9244bfb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.662845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904366e-6981-4a4b-89a9-59aea17d299c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.663652 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904366e-6981-4a4b-89a9-59aea17d299c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.664588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904366e-6981-4a4b-89a9-59aea17d299c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.664865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904366e-6981-4a4b-89a9-59aea17d299c None admin] PATH_INFO: `/v3/groups/dfb329583ffb46239c5aa56534c508aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.676047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904366e-6981-4a4b-89a9-59aea17d299c None admin] RBAC: Authorizing `identity:get_group(group_id=dfb329583ffb46239c5aa56534c508aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.677847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904366e-6981-4a4b-89a9-59aea17d299c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.680106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 193/382] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/groups/dfb329583ffb46239c5aa56534c508aa => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:02.691531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904366e-6981-4a4b-89a9-59aea17d299c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.706902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.734719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543b93b-dcc4-4bb2-95f3-1d5b79d45d7f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.762412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:02.804656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.805721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.806240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.807509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.808554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:02.809107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.810790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.832837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 190/383] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:02.839708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:02.874455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904366e-6981-4a4b-89a9-59aea17d299c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:02.945213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30650d03-a48a-4602-8c29-0d66a5c9f7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:02.948807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30650d03-a48a-4602-8c29-0d66a5c9f7ac None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:02.950185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30650d03-a48a-4602-8c29-0d66a5c9f7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:02.950692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30650d03-a48a-4602-8c29-0d66a5c9f7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:02.951801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30650d03-a48a-4602-8c29-0d66a5c9f7ac None admin] RBAC: Adding query filter params (group.id=dfb329583ffb46239c5aa56534c508aa, role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=d4d4adba733e41f4aa7039514b116efa) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:02.955243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30650d03-a48a-4602-8c29-0d66a5c9f7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:02.956961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30650d03-a48a-4602-8c29-0d66a5c9f7ac None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:02.967790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 194/384] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/role_assignments?group.id=dfb329583ffb46239c5aa56534c508aa&scope.project.id=d4d4adba733e41f4aa7039514b116efa&role.id=07de3e1931ca4d799df8510428e181aa => generated 260 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:03.027431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eae120-78e0-439a-8504-b91c14615c25 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.034649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a37a-4eb1-482e-8b4b-8804db1bf136 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.035264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a37a-4eb1-482e-8b4b-8804db1bf136 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.035760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1a37a-4eb1-482e-8b4b-8804db1bf136 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.037447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 195/385] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:03.045596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c478476-8163-40d8-ae2f-c667121083f7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.046252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c478476-8163-40d8-ae2f-c667121083f7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.046869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c478476-8163-40d8-ae2f-c667121083f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.066032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6c478476-8163-40d8-ae2f-c667121083f7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:03.067696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6c478476-8163-40d8-ae2f-c667121083f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:03.104309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af327d9a-ff15-4af8-b5c1-50d26c2c3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.105223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af327d9a-ff15-4af8-b5c1-50d26c2c3066 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.105510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af327d9a-ff15-4af8-b5c1-50d26c2c3066 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.105789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af327d9a-ff15-4af8-b5c1-50d26c2c3066 None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.107460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af327d9a-ff15-4af8-b5c1-50d26c2c3066 None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.109998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af327d9a-ff15-4af8-b5c1-50d26c2c3066 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.113704 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 191/386] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:02 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.120525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af327d9a-ff15-4af8-b5c1-50d26c2c3066 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.155869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.160710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 196/387] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:03.187278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c478476-8163-40d8-ae2f-c667121083f7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.246980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.300998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af327d9a-ff15-4af8-b5c1-50d26c2c3066 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.329907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c478476-8163-40d8-ae2f-c667121083f7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.347866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70d33a-5d0e-49f8-9e88-fedefd816586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.348754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70d33a-5d0e-49f8-9e88-fedefd816586 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.349035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70d33a-5d0e-49f8-9e88-fedefd816586 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.349311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70d33a-5d0e-49f8-9e88-fedefd816586 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.350552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70d33a-5d0e-49f8-9e88-fedefd816586 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.352089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70d33a-5d0e-49f8-9e88-fedefd816586 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.354820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 192/388] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:03.364579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70d33a-5d0e-49f8-9e88-fedefd816586 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.403891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db9b2-d23e-49fb-aa1e-284d7ffac97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.404709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db9b2-d23e-49fb-aa1e-284d7ffac97f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.404992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db9b2-d23e-49fb-aa1e-284d7ffac97f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.405266 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3db9b2-d23e-49fb-aa1e-284d7ffac97f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.433411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3db9b2-d23e-49fb-aa1e-284d7ffac97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7f3db9b2-d23e-49fb-aa1e-284d7ffac97f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:03.441692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:03.442725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:03.444201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 197/389] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:03.450819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db9b2-d23e-49fb-aa1e-284d7ffac97f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.511010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.546041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70d33a-5d0e-49f8-9e88-fedefd816586 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.614420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3db9b2-d23e-49fb-aa1e-284d7ffac97f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.621429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd7123-84d4-4bb7-8c91-98c2af9e2771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.622334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7123-84d4-4bb7-8c91-98c2af9e2771 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.622641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7123-84d4-4bb7-8c91-98c2af9e2771 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.622918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd7123-84d4-4bb7-8c91-98c2af9e2771 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346/groups/12b509b3bf2e41968403b8a44b5f7f8f/roles/af8d06df2b8647859f2fe7b60e0da912` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.629357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7123-84d4-4bb7-8c91-98c2af9e2771 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c571faec99847838c665f0fa1909346, group_id=12b509b3bf2e41968403b8a44b5f7f8f, role_id=af8d06df2b8647859f2fe7b60e0da912)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.630889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd7123-84d4-4bb7-8c91-98c2af9e2771 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.639448 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:03.670063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.670806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.671089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.671415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.672162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:03.672467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.673931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.684353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 198/390] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:03.690016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:03.706131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 193/391] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 26 12:25:03 2022] PUT /identity/v3/projects/3c571faec99847838c665f0fa1909346/groups/12b509b3bf2e41968403b8a44b5f7f8f/roles/af8d06df2b8647859f2fe7b60e0da912 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:25:03.834997 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d22f2-a05b-475d-80ef-da16d17d90a1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:03.883439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb36e64-8a1a-4a55-a5cb-58571426c2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:03.884802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb36e64-8a1a-4a55-a5cb-58571426c2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:03.885279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb36e64-8a1a-4a55-a5cb-58571426c2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:03.885794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb36e64-8a1a-4a55-a5cb-58571426c2f7 None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:03.887651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb36e64-8a1a-4a55-a5cb-58571426c2f7 None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:03.889414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb36e64-8a1a-4a55-a5cb-58571426c2f7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:03.891365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 199/392] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:03.897403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd7123-84d4-4bb7-8c91-98c2af9e2771 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.040760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd7123-84d4-4bb7-8c91-98c2af9e2771 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.091117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc65e4-5f72-46a1-be35-7eaf76d39ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.091980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc65e4-5f72-46a1-be35-7eaf76d39ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.092249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc65e4-5f72-46a1-be35-7eaf76d39ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.092511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc65e4-5f72-46a1-be35-7eaf76d39ca5 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.093750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc65e4-5f72-46a1-be35-7eaf76d39ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:04.095287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc65e4-5f72-46a1-be35-7eaf76d39ca5 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:04.097118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 194/393] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:03 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:04.103352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb36e64-8a1a-4a55-a5cb-58571426c2f7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:04.154844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:04.237123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb36e64-8a1a-4a55-a5cb-58571426c2f7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:04.294576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31503e30-8481-40ab-a8d7-fff8bcf3af74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:04.296058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503e30-8481-40ab-a8d7-fff8bcf3af74 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.296572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503e30-8481-40ab-a8d7-fff8bcf3af74 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.297076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31503e30-8481-40ab-a8d7-fff8bcf3af74 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346/groups/12b509b3bf2e41968403b8a44b5f7f8f/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.309503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31503e30-8481-40ab-a8d7-fff8bcf3af74 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c571faec99847838c665f0fa1909346, group_id=12b509b3bf2e41968403b8a44b5f7f8f, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:04.311027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31503e30-8481-40ab-a8d7-fff8bcf3af74 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:04.410415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 200/394] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 26 12:25:04 2022] PUT /identity/v3/projects/3c571faec99847838c665f0fa1909346/groups/12b509b3bf2e41968403b8a44b5f7f8f/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:04.992049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a640d4-d452-4fba-9f06-a657cb02f8ed None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:04.992049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a640d4-d452-4fba-9f06-a657cb02f8ed None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:04.992049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a640d4-d452-4fba-9f06-a657cb02f8ed None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:04.999069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 195/395] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:04 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:04.999728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a504ad-9b7b-499b-85c1-f95cc8114d83 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.000021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a504ad-9b7b-499b-85c1-f95cc8114d83 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.000301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a504ad-9b7b-499b-85c1-f95cc8114d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.046701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c0a504ad-9b7b-499b-85c1-f95cc8114d83 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:05.047926 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c0a504ad-9b7b-499b-85c1-f95cc8114d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:05.101616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124ecb7-8cac-4706-a7d1-71e05b66e713 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.102613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124ecb7-8cac-4706-a7d1-71e05b66e713 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.104419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124ecb7-8cac-4706-a7d1-71e05b66e713 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.113214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 196/396] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:05.114911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7321d-9010-4365-ba1e-169a2ff78f9b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.116932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7321d-9010-4365-ba1e-169a2ff78f9b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.117587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb7321d-9010-4365-ba1e-169a2ff78f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.170616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9eb7321d-9010-4365-ba1e-169a2ff78f9b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:05.172382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9eb7321d-9010-4365-ba1e-169a2ff78f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:05.175917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.228459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 201/397] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:05.283296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a504ad-9b7b-499b-85c1-f95cc8114d83 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.324983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.370706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 197/398] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:05.429780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a504ad-9b7b-499b-85c1-f95cc8114d83 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.432344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7321d-9010-4365-ba1e-169a2ff78f9b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.472148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6f12c-5364-4c2b-841c-e948bd3e6e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.473316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6f12c-5364-4c2b-841c-e948bd3e6e8c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.473798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6f12c-5364-4c2b-841c-e948bd3e6e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.474266 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6f12c-5364-4c2b-841c-e948bd3e6e8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.487278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6f12c-5364-4c2b-841c-e948bd3e6e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-58a6f12c-5364-4c2b-841c-e948bd3e6e8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:05.496786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.497987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:25:05.498828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:05.501412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 202/399] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:05.507157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6f12c-5364-4c2b-841c-e948bd3e6e8c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.633379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb7321d-9010-4365-ba1e-169a2ff78f9b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.712135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148a305-501e-4142-aae4-70400c5e27ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.713417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a305-501e-4142-aae4-70400c5e27ac None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.713941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a305-501e-4142-aae4-70400c5e27ac None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.714450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d148a305-501e-4142-aae4-70400c5e27ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.720715 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.739720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:05.742982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6f12c-5364-4c2b-841c-e948bd3e6e8c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.744758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d148a305-501e-4142-aae4-70400c5e27ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-d148a305-501e-4142-aae4-70400c5e27ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:05.760230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:05.761274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:05.762075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 198/400] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:05.771787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148a305-501e-4142-aae4-70400c5e27ac None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.788984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.789821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.790130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.792274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.792274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:05.792466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.793835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.803597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 203/401] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:05.811249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:05.924937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b7cf-fead-4e21-8842-99649ed486c0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:05.963439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcc08a-ef90-4a9b-b818-24b5bcb81a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:05.964416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcc08a-ef90-4a9b-b818-24b5bcb81a5f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:05.964705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcc08a-ef90-4a9b-b818-24b5bcb81a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:05.964984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bcc08a-ef90-4a9b-b818-24b5bcb81a5f None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:05.966203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcc08a-ef90-4a9b-b818-24b5bcb81a5f None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:05.967928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bcc08a-ef90-4a9b-b818-24b5bcb81a5f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:05.969889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 204/402] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:05.979231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcc08a-ef90-4a9b-b818-24b5bcb81a5f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.000568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.081600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d148a305-501e-4142-aae4-70400c5e27ac None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.102948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bcc08a-ef90-4a9b-b818-24b5bcb81a5f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.141484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.142167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.142451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.144230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e877d-36b5-4e83-87f6-e3379c1c796e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.145153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e877d-36b5-4e83-87f6-e3379c1c796e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.145438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e877d-36b5-4e83-87f6-e3379c1c796e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.145717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6e877d-36b5-4e83-87f6-e3379c1c796e None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.147228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e877d-36b5-4e83-87f6-e3379c1c796e None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.148669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6e877d-36b5-4e83-87f6-e3379c1c796e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.151061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.151515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 205/403] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:06.152401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:06.152908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.162395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.163809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e877d-36b5-4e83-87f6-e3379c1c796e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.170407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 199/404] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.178206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.307889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.320784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.347155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6e877d-36b5-4e83-87f6-e3379c1c796e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.356361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33248a5-2d2e-4c25-9264-2aac0878dead None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.396389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8bf67-1aa8-43ad-b8ed-35ee5359cf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.397646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8bf67-1aa8-43ad-b8ed-35ee5359cf64 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.398060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075533be-4e4e-4071-9864-e53acd3996f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.398383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8bf67-1aa8-43ad-b8ed-35ee5359cf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.398884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8bf67-1aa8-43ad-b8ed-35ee5359cf64 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/groups/12b509b3bf2e41968403b8a44b5f7f8f/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.398988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075533be-4e4e-4071-9864-e53acd3996f7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.399328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075533be-4e4e-4071-9864-e53acd3996f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.400460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075533be-4e4e-4071-9864-e53acd3996f7 None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.402556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075533be-4e4e-4071-9864-e53acd3996f7 None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.403300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8bf67-1aa8-43ad-b8ed-35ee5359cf64 None admin] RBAC: Authorizing `identity:create_grant(project_id=7038bd1c4ee44ca29197ba920c0fde7b, group_id=12b509b3bf2e41968403b8a44b5f7f8f, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.404061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075533be-4e4e-4071-9864-e53acd3996f7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.405160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8bf67-1aa8-43ad-b8ed-35ee5359cf64 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.406024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 200/405] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.407345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556849-51e0-4063-8d79-f9caf98079c0 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.407628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556849-51e0-4063-8d79-f9caf98079c0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.407902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556849-51e0-4063-8d79-f9caf98079c0 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.413668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 201/406] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:06.414549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77556849-51e0-4063-8d79-f9caf98079c0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.522226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 206/407] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 26 12:25:06 2022] PUT /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/groups/12b509b3bf2e41968403b8a44b5f7f8f/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:06.525073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b129-9349-4836-8a15-b5bb2092cc6d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.525912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b129-9349-4836-8a15-b5bb2092cc6d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.526838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587b129-9349-4836-8a15-b5bb2092cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.554467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c587b129-9349-4836-8a15-b5bb2092cc6d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:06.559340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c587b129-9349-4836-8a15-b5bb2092cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:06.577373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77556849-51e0-4063-8d79-f9caf98079c0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.639612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.659330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e24a74-9255-4fc7-b9cc-f6a086650395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.660235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24a74-9255-4fc7-b9cc-f6a086650395 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.660515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24a74-9255-4fc7-b9cc-f6a086650395 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.660794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e24a74-9255-4fc7-b9cc-f6a086650395 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.662106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e24a74-9255-4fc7-b9cc-f6a086650395 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.663618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e24a74-9255-4fc7-b9cc-f6a086650395 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.666457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 202/408] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:06.672402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e24a74-9255-4fc7-b9cc-f6a086650395 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.679420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 207/409] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:06.693513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888092d-555a-4b3b-af42-52a5b4cdf267 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.694132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888092d-555a-4b3b-af42-52a5b4cdf267 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.694649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888092d-555a-4b3b-af42-52a5b4cdf267 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.696965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 208/410] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:06.706087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8502cfc-bfd5-46e9-b1e3-1aafdf72cf6d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.706814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8502cfc-bfd5-46e9-b1e3-1aafdf72cf6d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.707394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8502cfc-bfd5-46e9-b1e3-1aafdf72cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.733178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c8502cfc-bfd5-46e9-b1e3-1aafdf72cf6d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:06.735991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c8502cfc-bfd5-46e9-b1e3-1aafdf72cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:06.813999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e24a74-9255-4fc7-b9cc-f6a086650395 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.831347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 209/411] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:06.832088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8502cfc-bfd5-46e9-b1e3-1aafdf72cf6d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.837422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:06.883806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d97693-f2f4-45e2-9b83-453696e90492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.885477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d97693-f2f4-45e2-9b83-453696e90492 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.885916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d97693-f2f4-45e2-9b83-453696e90492 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.886329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d97693-f2f4-45e2-9b83-453696e90492 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/groups/12b509b3bf2e41968403b8a44b5f7f8f/roles/af8d06df2b8647859f2fe7b60e0da912` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:06.889205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d97693-f2f4-45e2-9b83-453696e90492 None admin] RBAC: Authorizing `identity:create_grant(project_id=7038bd1c4ee44ca29197ba920c0fde7b, group_id=12b509b3bf2e41968403b8a44b5f7f8f, role_id=af8d06df2b8647859f2fe7b60e0da912)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:06.890813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d97693-f2f4-45e2-9b83-453696e90492 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:06.945015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8502cfc-bfd5-46e9-b1e3-1aafdf72cf6d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:06.964745 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 203/412] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 26 12:25:06 2022] PUT /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b/groups/12b509b3bf2e41968403b8a44b5f7f8f/roles/af8d06df2b8647859f2fe7b60e0da912 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:06.966545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d97693-f2f4-45e2-9b83-453696e90492 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:06.991283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b6c60-080d-4479-9934-9f7d819f00f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:06.992050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b6c60-080d-4479-9934-9f7d819f00f0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:06.992331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b6c60-080d-4479-9934-9f7d819f00f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:06.992605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b6c60-080d-4479-9934-9f7d819f00f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.007369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1b6c60-080d-4479-9934-9f7d819f00f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4c1b6c60-080d-4479-9934-9f7d819f00f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:07.017301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:07.018388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:07.019303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 210/413] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:07.028216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b6c60-080d-4479-9934-9f7d819f00f0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.085918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.171899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.224131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1b6c60-080d-4479-9934-9f7d819f00f0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.224925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d97693-f2f4-45e2-9b83-453696e90492 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.268467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274ae2-cb60-4464-8cf2-5c65b593b2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.269315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274ae2-cb60-4464-8cf2-5c65b593b2e7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.269591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274ae2-cb60-4464-8cf2-5c65b593b2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.269860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274ae2-cb60-4464-8cf2-5c65b593b2e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.272238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.273453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.274273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.274619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.278701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.278701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.278701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.289253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25274ae2-cb60-4464-8cf2-5c65b593b2e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:07.289714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 211/414] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.296246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-25274ae2-cb60-4464-8cf2-5c65b593b2e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:07.299228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:07.300269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:07.301250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:07.305240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 204/415] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:25:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:07.314113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274ae2-cb60-4464-8cf2-5c65b593b2e7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.488782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0c967-d813-45b6-8bb0-648b86d61acb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.543140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.547623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274ae2-cb60-4464-8cf2-5c65b593b2e7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.557947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ca272-43e8-4109-83b3-ad93d7c892b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.559307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca272-43e8-4109-83b3-ad93d7c892b4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.559794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca272-43e8-4109-83b3-ad93d7c892b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.560390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ca272-43e8-4109-83b3-ad93d7c892b4 None admin] PATH_INFO: `/v3/groups/dfb329583ffb46239c5aa56534c508aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.562109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca272-43e8-4109-83b3-ad93d7c892b4 None admin] RBAC: Authorizing `identity:get_group(group_id=dfb329583ffb46239c5aa56534c508aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.564710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ca272-43e8-4109-83b3-ad93d7c892b4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.567505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 212/416] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/groups/dfb329583ffb46239c5aa56534c508aa => generated 229 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:07.569107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4bd6-0399-4c5b-a9dc-310b44aa909e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.569623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4bd6-0399-4c5b-a9dc-310b44aa909e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.570280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab4bd6-0399-4c5b-a9dc-310b44aa909e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.572913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.579897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 213/417] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:07.579897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4bd6-0399-4c5b-a9dc-310b44aa909e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.600142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429e985-7396-4b50-a7d2-ba5f775d358a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.605425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429e985-7396-4b50-a7d2-ba5f775d358a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.605425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429e985-7396-4b50-a7d2-ba5f775d358a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.605425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429e985-7396-4b50-a7d2-ba5f775d358a None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.605425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429e985-7396-4b50-a7d2-ba5f775d358a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:07.605425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429e985-7396-4b50-a7d2-ba5f775d358a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.605425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5429e985-7396-4b50-a7d2-ba5f775d358a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.621834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 205/418] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.621834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f966f96-cc63-468a-9dfa-800e4e704549 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.621834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f966f96-cc63-468a-9dfa-800e4e704549 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.621834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f966f96-cc63-468a-9dfa-800e4e704549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.642118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-2f966f96-cc63-468a-9dfa-800e4e704549 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:07.643659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2f966f96-cc63-468a-9dfa-800e4e704549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:07.718963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 206/419] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:07.720223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f966f96-cc63-468a-9dfa-800e4e704549 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.735170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab4bd6-0399-4c5b-a9dc-310b44aa909e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.779384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82328-8fbe-4752-9757-81cbf6f3b0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.780775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82328-8fbe-4752-9757-81cbf6f3b0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.781254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82328-8fbe-4752-9757-81cbf6f3b0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.781721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82328-8fbe-4752-9757-81cbf6f3b0f5 None admin] PATH_INFO: `/v3/projects/d4d4adba733e41f4aa7039514b116efa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.783241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf82328-8fbe-4752-9757-81cbf6f3b0f5 None admin] RBAC: Authorizing `identity:get_project(project_id=d4d4adba733e41f4aa7039514b116efa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:07.785314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf82328-8fbe-4752-9757-81cbf6f3b0f5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:07.787709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 214/420] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/projects/d4d4adba733e41f4aa7039514b116efa => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:07.788735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82328-8fbe-4752-9757-81cbf6f3b0f5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:07.866748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.882719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f966f96-cc63-468a-9dfa-800e4e704549 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.897460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:07.932112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b903a-31b0-49df-84ce-c30073b78060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.933260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b903a-31b0-49df-84ce-c30073b78060 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.933744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b903a-31b0-49df-84ce-c30073b78060 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.934422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b903a-31b0-49df-84ce-c30073b78060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.935179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82328-8fbe-4752-9757-81cbf6f3b0f5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:07.974319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e6107-7b97-404c-a7aa-fd68ea2742f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:07.975175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e6107-7b97-404c-a7aa-fd68ea2742f5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:07.975453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e6107-7b97-404c-a7aa-fd68ea2742f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:07.975772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e6107-7b97-404c-a7aa-fd68ea2742f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:07.988244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e6107-7b97-404c-a7aa-fd68ea2742f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-125e6107-7b97-404c-a7aa-fd68ea2742f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:07.996551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:07.997515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:07.998311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 215/421] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:07.999178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e6107-7b97-404c-a7aa-fd68ea2742f5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.044562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b903a-31b0-49df-84ce-c30073b78060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.045945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b903a-31b0-49df-84ce-c30073b78060 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.126790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e6107-7b97-404c-a7aa-fd68ea2742f5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.161310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.174180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 207/422] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:08.175088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b903a-31b0-49df-84ce-c30073b78060 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.180465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115eba-2847-41a7-bbd4-02d2dbc43f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.180465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115eba-2847-41a7-bbd4-02d2dbc43f64 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.180465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115eba-2847-41a7-bbd4-02d2dbc43f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.181596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72115eba-2847-41a7-bbd4-02d2dbc43f64 None admin] PATH_INFO: `/v3/projects/d4d4adba733e41f4aa7039514b116efa/groups/dfb329583ffb46239c5aa56534c508aa/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.184105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115eba-2847-41a7-bbd4-02d2dbc43f64 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4d4adba733e41f4aa7039514b116efa, group_id=dfb329583ffb46239c5aa56534c508aa, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.186336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72115eba-2847-41a7-bbd4-02d2dbc43f64 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.189224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.282390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 216/423] 10.222.0.60 () {58 vars in 1442 bytes} [Thu May 26 12:25:07 2022] PUT /identity/v3/projects/d4d4adba733e41f4aa7039514b116efa/groups/dfb329583ffb46239c5aa56534c508aa/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:08.283625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115eba-2847-41a7-bbd4-02d2dbc43f64 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.330474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b903a-31b0-49df-84ce-c30073b78060 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.419850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.420992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.421370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.422821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.423631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:08.423946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.428771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.457832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 208/424] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:08.459485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.515848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72115eba-2847-41a7-bbd4-02d2dbc43f64 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.556877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.558761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900620f-a303-4c2d-add4-c6020223b940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.560824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900620f-a303-4c2d-add4-c6020223b940 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.560824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900620f-a303-4c2d-add4-c6020223b940 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.560824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900620f-a303-4c2d-add4-c6020223b940 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.561799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900620f-a303-4c2d-add4-c6020223b940 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.563554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900620f-a303-4c2d-add4-c6020223b940 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.566087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 217/425] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:08.573009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900620f-a303-4c2d-add4-c6020223b940 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.599530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb4a96-a87a-496d-b563-4e5fa64d78ad None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.651206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:08.667191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7c1f-ec5c-40fc-ab5b-3ff4228afc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.667991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7c1f-ec5c-40fc-ab5b-3ff4228afc29 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.668300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7c1f-ec5c-40fc-ab5b-3ff4228afc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.668671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e7c1f-ec5c-40fc-ab5b-3ff4228afc29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.769311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900620f-a303-4c2d-add4-c6020223b940 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:08.818702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e7c1f-ec5c-40fc-ab5b-3ff4228afc29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.819377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e7c1f-ec5c-40fc-ab5b-3ff4228afc29 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.865830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad783f5-6f99-4c12-acd8-afcddd7f1c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:08.866660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad783f5-6f99-4c12-acd8-afcddd7f1c5b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:08.866945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad783f5-6f99-4c12-acd8-afcddd7f1c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:08.867221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad783f5-6f99-4c12-acd8-afcddd7f1c5b None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:08.869375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad783f5-6f99-4c12-acd8-afcddd7f1c5b None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:08.870973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad783f5-6f99-4c12-acd8-afcddd7f1c5b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:08.878206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 218/426] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:08.879132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad783f5-6f99-4c12-acd8-afcddd7f1c5b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:08.974949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.046910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 209/427] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:09.047995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7c1f-ec5c-40fc-ab5b-3ff4228afc29 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.085651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad783f5-6f99-4c12-acd8-afcddd7f1c5b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.116499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.163525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.164215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.164503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.164787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.166873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] RBAC: Adding query filter params (group.id=12b509b3bf2e41968403b8a44b5f7f8f, role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=3c571faec99847838c665f0fa1909346) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.167196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.169681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.190953 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 219/428] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:25:08 2022] GET /identity/v3/role_assignments?group.id=12b509b3bf2e41968403b8a44b5f7f8f&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 611 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.232214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e7c1f-ec5c-40fc-ab5b-3ff4228afc29 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.278466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d8254-7301-476e-953f-f48cb29b2756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.282055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d8254-7301-476e-953f-f48cb29b2756 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.282055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d8254-7301-476e-953f-f48cb29b2756 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.282055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d8254-7301-476e-953f-f48cb29b2756 None admin] PATH_INFO: `/v3/projects/3c571faec99847838c665f0fa1909346` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.282055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d8254-7301-476e-953f-f48cb29b2756 None admin] RBAC: Authorizing `identity:get_project(project_id=3c571faec99847838c665f0fa1909346)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.286566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d8254-7301-476e-953f-f48cb29b2756 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.286566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 210/429] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/projects/3c571faec99847838c665f0fa1909346 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.292350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.419426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957a74-3f21-43c5-ad7f-5d48159e7b6c None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.419826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957a74-3f21-43c5-ad7f-5d48159e7b6c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.420011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98957a74-3f21-43c5-ad7f-5d48159e7b6c None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.421986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 211/430] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:09.428193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b2d6e-8029-46d2-8a07-b4e6203b3700 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.428477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b2d6e-8029-46d2-8a07-b4e6203b3700 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.428751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b2d6e-8029-46d2-8a07-b4e6203b3700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.451405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-8c8b2d6e-8029-46d2-8a07-b4e6203b3700 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:09.453526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8c8b2d6e-8029-46d2-8a07-b4e6203b3700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:09.480239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08991960-3417-42e7-bd48-27765d1df1b6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.504866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.529727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914b94e-c7ad-44a7-ac0e-539d152e87ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.530617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914b94e-c7ad-44a7-ac0e-539d152e87ef None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.531725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914b94e-c7ad-44a7-ac0e-539d152e87ef None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.531725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914b94e-c7ad-44a7-ac0e-539d152e87ef None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.533465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914b94e-c7ad-44a7-ac0e-539d152e87ef None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.535004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914b94e-c7ad-44a7-ac0e-539d152e87ef None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.542227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 220/431] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.544406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914b94e-c7ad-44a7-ac0e-539d152e87ef None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.555939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 212/432] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:09.582937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b2d6e-8029-46d2-8a07-b4e6203b3700 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.605447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.663453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914b94e-c7ad-44a7-ac0e-539d152e87ef None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.699577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b2d6e-8029-46d2-8a07-b4e6203b3700 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.718026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.718756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.719040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.719318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.720171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] RBAC: Adding query filter params (group.id=12b509b3bf2e41968403b8a44b5f7f8f, role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=3c571faec99847838c665f0fa1909346) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.720485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.722890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.730573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 221/433] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/role_assignments?group.id=12b509b3bf2e41968403b8a44b5f7f8f&scope.project.id=3c571faec99847838c665f0fa1909346&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.752433 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9725e-deec-4c02-a351-db115cc2e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.753350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9725e-deec-4c02-a351-db115cc2e20e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.753734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9725e-deec-4c02-a351-db115cc2e20e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.754076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9725e-deec-4c02-a351-db115cc2e20e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.767636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9725e-deec-4c02-a351-db115cc2e20e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-40c9725e-deec-4c02-a351-db115cc2e20e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:09.776395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:09.777375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:09.778275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 213/434] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:09.784538 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:09.911900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d89719-155b-4872-8751-d184aae84af0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:09.931489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:09.957444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a38d7e-88c6-462e-84e8-ec1082539e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:09.958466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38d7e-88c6-462e-84e8-ec1082539e46 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:09.959032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38d7e-88c6-462e-84e8-ec1082539e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:09.959496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a38d7e-88c6-462e-84e8-ec1082539e46 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:09.960440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38d7e-88c6-462e-84e8-ec1082539e46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:09.961065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38d7e-88c6-462e-84e8-ec1082539e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:09.962708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a38d7e-88c6-462e-84e8-ec1082539e46 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:09.973981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 222/435] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:09.980009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9725e-deec-4c02-a351-db115cc2e20e None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.015684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.082707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee99243-e633-4396-85c7-cd48a1b3a616 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.082990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee99243-e633-4396-85c7-cd48a1b3a616 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.083299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee99243-e633-4396-85c7-cd48a1b3a616 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.084924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 223/436] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:10.096138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d05ac-0d05-4d37-8a1c-918d7fcf599d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.096414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d05ac-0d05-4d37-8a1c-918d7fcf599d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.096747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d05ac-0d05-4d37-8a1c-918d7fcf599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.106697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9725e-deec-4c02-a351-db115cc2e20e None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.122740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ee0d05ac-0d05-4d37-8a1c-918d7fcf599d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:10.125008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ee0d05ac-0d05-4d37-8a1c-918d7fcf599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:10.148271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc785-2b10-4827-9d88-f62748fcb8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.148918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc785-2b10-4827-9d88-f62748fcb8ed None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.149197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc785-2b10-4827-9d88-f62748fcb8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.149575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abccc785-2b10-4827-9d88-f62748fcb8ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.218611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 224/437] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:10.250146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d05ac-0d05-4d37-8a1c-918d7fcf599d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.256384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccc785-2b10-4827-9d88-f62748fcb8ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.258431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abccc785-2b10-4827-9d88-f62748fcb8ed None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.307072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.392138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d05ac-0d05-4d37-8a1c-918d7fcf599d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.401669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.402848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 214/438] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:10.408546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc785-2b10-4827-9d88-f62748fcb8ed None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.434877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a9077-eda9-4a35-a849-c28ff6634ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.436272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9077-eda9-4a35-a849-c28ff6634ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.436539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9077-eda9-4a35-a849-c28ff6634ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.436810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9077-eda9-4a35-a849-c28ff6634ff3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.451416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a9077-eda9-4a35-a849-c28ff6634ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-786a9077-eda9-4a35-a849-c28ff6634ff3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:10.460693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:10.461712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:10.463108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:10.469442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 225/439] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:10.471215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a9077-eda9-4a35-a849-c28ff6634ff3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.559308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abccc785-2b10-4827-9d88-f62748fcb8ed None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.602667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.611069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17b64e-b8fc-41de-a3e5-45a882a0846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.612283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17b64e-b8fc-41de-a3e5-45a882a0846b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.628655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17b64e-b8fc-41de-a3e5-45a882a0846b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.628655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a17b64e-b8fc-41de-a3e5-45a882a0846b None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.628954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a9077-eda9-4a35-a849-c28ff6634ff3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.629383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17b64e-b8fc-41de-a3e5-45a882a0846b None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.629383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a17b64e-b8fc-41de-a3e5-45a882a0846b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.629383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 215/440] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:10.629383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17b64e-b8fc-41de-a3e5-45a882a0846b None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.655566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.656536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.656950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.657392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.658291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:10.658940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.660427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.670362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 226/441] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:10.675877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.710167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.744580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a17b64e-b8fc-41de-a3e5-45a882a0846b None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.788642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86052548-917d-43f6-b30e-d24e5e7782dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.789534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052548-917d-43f6-b30e-d24e5e7782dc None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.789812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052548-917d-43f6-b30e-d24e5e7782dc None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.790232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86052548-917d-43f6-b30e-d24e5e7782dc None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.791932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86052548-917d-43f6-b30e-d24e5e7782dc None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.793571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86052548-917d-43f6-b30e-d24e5e7782dc None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.795738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 216/442] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:10.801708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86052548-917d-43f6-b30e-d24e5e7782dc None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:10.803547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4b92f5-38fb-4ff4-95e4-2c251888611c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.843237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68d18b-fc59-43b5-a009-7bf290f1e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.843902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68d18b-fc59-43b5-a009-7bf290f1e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.844180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68d18b-fc59-43b5-a009-7bf290f1e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.844452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b68d18b-fc59-43b5-a009-7bf290f1e5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.877146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.920372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86052548-917d-43f6-b30e-d24e5e7782dc None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:10.929170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68d18b-fc59-43b5-a009-7bf290f1e5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.931060 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b68d18b-fc59-43b5-a009-7bf290f1e5b7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.970046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4bfb15-0f07-4246-ae6c-555cc9ce859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:10.970760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bfb15-0f07-4246-ae6c-555cc9ce859f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.971050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bfb15-0f07-4246-ae6c-555cc9ce859f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.971412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4bfb15-0f07-4246-ae6c-555cc9ce859f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.972258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bfb15-0f07-4246-ae6c-555cc9ce859f None admin] RBAC: Adding query filter params (group.id=12b509b3bf2e41968403b8a44b5f7f8f, role.id=b6f4cd580a914b0aa8c3a237d63e5350, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:10.972376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:10.972575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bfb15-0f07-4246-ae6c-555cc9ce859f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:10.974017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4bfb15-0f07-4246-ae6c-555cc9ce859f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:10.980616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 217/443] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/role_assignments?group.id=12b509b3bf2e41968403b8a44b5f7f8f&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=b6f4cd580a914b0aa8c3a237d63e5350 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:10.982118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51ed9-4c66-4ac2-a3a4-caf4e29be9c6 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.982407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51ed9-4c66-4ac2-a3a4-caf4e29be9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.988405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a51ed9-4c66-4ac2-a3a4-caf4e29be9c6 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:10.988405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 218/444] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:10.990666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b9f7-92e4-4d8f-bfba-c9d0050fe89f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:10.990971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b9f7-92e4-4d8f-bfba-c9d0050fe89f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:10.991237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73b9f7-92e4-4d8f-bfba-c9d0050fe89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.017387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ab73b9f7-92e4-4d8f-bfba-c9d0050fe89f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:11.018703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ab73b9f7-92e4-4d8f-bfba-c9d0050fe89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:11.072565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 227/445] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:25:11.076906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68d18b-fc59-43b5-a009-7bf290f1e5b7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.102875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 219/446] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:11.125828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73b9f7-92e4-4d8f-bfba-c9d0050fe89f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.204475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.222258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b68d18b-fc59-43b5-a009-7bf290f1e5b7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.254287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73b9f7-92e4-4d8f-bfba-c9d0050fe89f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.259537 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.268839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a8347-99d1-4484-8183-513d8c0312e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.270982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a8347-99d1-4484-8183-513d8c0312e0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.271269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a8347-99d1-4484-8183-513d8c0312e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.271539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a8347-99d1-4484-8183-513d8c0312e0 None admin] PATH_INFO: `/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.272834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a8347-99d1-4484-8183-513d8c0312e0 None admin] RBAC: Authorizing `identity:get_project(project_id=7038bd1c4ee44ca29197ba920c0fde7b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.276875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a8347-99d1-4484-8183-513d8c0312e0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.282704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 228/447] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/projects/7038bd1c4ee44ca29197ba920c0fde7b => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:11.288851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a8347-99d1-4484-8183-513d8c0312e0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.304782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb44ab-7f29-412c-9df9-543e4ae8dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.307635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb44ab-7f29-412c-9df9-543e4ae8dabb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.307635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb44ab-7f29-412c-9df9-543e4ae8dabb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.307635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb44ab-7f29-412c-9df9-543e4ae8dabb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.327843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb44ab-7f29-412c-9df9-543e4ae8dabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-24cb44ab-7f29-412c-9df9-543e4ae8dabb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:11.336948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:11.337980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:11.338880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 220/448] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:11.345120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb44ab-7f29-412c-9df9-543e4ae8dabb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.441919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a8347-99d1-4484-8183-513d8c0312e0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.474557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb44ab-7f29-412c-9df9-543e4ae8dabb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.481204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626d2f0-bae4-4bfb-8ee7-adeebb5c79af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.482074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626d2f0-bae4-4bfb-8ee7-adeebb5c79af None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.482351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626d2f0-bae4-4bfb-8ee7-adeebb5c79af None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.482657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626d2f0-bae4-4bfb-8ee7-adeebb5c79af None admin] PATH_INFO: `/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.483858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626d2f0-bae4-4bfb-8ee7-adeebb5c79af None admin] RBAC: Authorizing `identity:get_group(group_id=12b509b3bf2e41968403b8a44b5f7f8f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.485299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626d2f0-bae4-4bfb-8ee7-adeebb5c79af None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.487230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 229/449] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/groups/12b509b3bf2e41968403b8a44b5f7f8f => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:11.493054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626d2f0-bae4-4bfb-8ee7-adeebb5c79af None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.497342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.511449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.512361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.512638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.512914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.513826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:11.514130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.515617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.525486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 221/450] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:11.530863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.561390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.607018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626d2f0-bae4-4bfb-8ee7-adeebb5c79af None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.650695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712aba3d-be2a-4df6-847a-722601cf7bc6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:11.654639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.654639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.654639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.655303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.655990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] RBAC: Adding query filter params (group.id=12b509b3bf2e41968403b8a44b5f7f8f, role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:11.656306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.657830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.665725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 230/451] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/role_assignments?group.id=12b509b3bf2e41968403b8a44b5f7f8f&scope.project.id=7038bd1c4ee44ca29197ba920c0fde7b&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:11.690543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd92d-5623-4204-8931-ee54ead457b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:11.691223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd92d-5623-4204-8931-ee54ead457b6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:11.691504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd92d-5623-4204-8931-ee54ead457b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:11.691775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bd92d-5623-4204-8931-ee54ead457b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:11.748663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:11.768674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd92d-5623-4204-8931-ee54ead457b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:11.770166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bd92d-5623-4204-8931-ee54ead457b6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:11.882396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 222/452] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 12:25:11.888392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:11.997130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8296c-6398-4b15-a25d-372fb57f7fb6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.024960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.032943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b60c-00b3-4163-8580-e69f5481237e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.033903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b60c-00b3-4163-8580-e69f5481237e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.040692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b60c-00b3-4163-8580-e69f5481237e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.040692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b60c-00b3-4163-8580-e69f5481237e None admin] PATH_INFO: `/v3/projects/d4d4adba733e41f4aa7039514b116efa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.040692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b60c-00b3-4163-8580-e69f5481237e None admin] RBAC: Authorizing `identity:get_project(project_id=d4d4adba733e41f4aa7039514b116efa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.040692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b60c-00b3-4163-8580-e69f5481237e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.040692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 231/453] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:25:11 2022] GET /identity/v3/projects/d4d4adba733e41f4aa7039514b116efa => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:12.045359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd92d-5623-4204-8931-ee54ead457b6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.131172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:12.150930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bd92d-5623-4204-8931-ee54ead457b6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.190590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a1511-4a2b-4bab-a235-b8249d26fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.191437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1511-4a2b-4bab-a235-b8249d26fece None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.191729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1511-4a2b-4bab-a235-b8249d26fece None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.192002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a1511-4a2b-4bab-a235-b8249d26fece None admin] PATH_INFO: `/v3/groups/dfb329583ffb46239c5aa56534c508aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.193174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a1511-4a2b-4bab-a235-b8249d26fece None admin] RBAC: Authorizing `identity:get_group(group_id=dfb329583ffb46239c5aa56534c508aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.194644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a1511-4a2b-4bab-a235-b8249d26fece None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.196934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 223/454] 10.222.0.60 () {56 vars in 1180 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/groups/dfb329583ffb46239c5aa56534c508aa => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:12.203165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b60c-00b3-4163-8580-e69f5481237e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:12.308905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b60c-00b3-4163-8580-e69f5481237e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:12.343360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba4ab0e-aef6-45a7-8962-ddee56d123ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:12.344003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ab0e-aef6-45a7-8962-ddee56d123ab None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:12.344285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ab0e-aef6-45a7-8962-ddee56d123ab None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:12.344558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba4ab0e-aef6-45a7-8962-ddee56d123ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:12.345380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4ab0e-aef6-45a7-8962-ddee56d123ab None admin] RBAC: Adding query filter params (group.id=dfb329583ffb46239c5aa56534c508aa, role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=d4d4adba733e41f4aa7039514b116efa) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:12.345747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4ab0e-aef6-45a7-8962-ddee56d123ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:12.347277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba4ab0e-aef6-45a7-8962-ddee56d123ab None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:12.353155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 232/455] 10.222.0.60 () {56 vars in 1376 bytes} [Thu May 26 12:25:12 2022] GET /identity/v3/role_assignments?group.id=dfb329583ffb46239c5aa56534c508aa&scope.project.id=d4d4adba733e41f4aa7039514b116efa&role.id=07de3e1931ca4d799df8510428e181aa => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:15.189412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d9f4-a732-4e67-b5a1-7ec145f2c122 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.189944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d9f4-a732-4e67-b5a1-7ec145f2c122 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.189944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6d9f4-a732-4e67-b5a1-7ec145f2c122 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.191747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 224/456] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:15.204496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83790fe-2b2c-4ebe-ae55-72c38b2c1f38 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.205011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83790fe-2b2c-4ebe-ae55-72c38b2c1f38 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.205086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83790fe-2b2c-4ebe-ae55-72c38b2c1f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.228138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b83790fe-2b2c-4ebe-ae55-72c38b2c1f38 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:15.229362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b83790fe-2b2c-4ebe-ae55-72c38b2c1f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:15.304329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.322030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 233/457] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:15.358060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6d9f4-a732-4e67-b5a1-7ec145f2c122 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.405812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b34aa-1cb5-42d4-bbe2-c3a4654e81ce None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.406158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b34aa-1cb5-42d4-bbe2-c3a4654e81ce None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.406356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b34aa-1cb5-42d4-bbe2-c3a4654e81ce None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.409185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 234/458] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:15.419464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91298-20ab-4ce6-b9f9-86488317c1c3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.420043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91298-20ab-4ce6-b9f9-86488317c1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.420544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b91298-20ab-4ce6-b9f9-86488317c1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.448099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a0b91298-20ab-4ce6-b9f9-86488317c1c3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:15.450299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a0b91298-20ab-4ce6-b9f9-86488317c1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:15.521136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6d9f4-a732-4e67-b5a1-7ec145f2c122 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.566549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 235/459] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:15.566549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e14c6-9777-444a-915c-47fd1c4be6cc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.566549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e14c6-9777-444a-915c-47fd1c4be6cc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.566549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e14c6-9777-444a-915c-47fd1c4be6cc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.567129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 236/460] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:15.568910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51e52e-5a78-495d-a1ac-acc42d48e35a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.569273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51e52e-5a78-495d-a1ac-acc42d48e35a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.569620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51e52e-5a78-495d-a1ac-acc42d48e35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.588644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9b51e52e-5a78-495d-a1ac-acc42d48e35a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:15.589126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.590112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.590330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b51e52e-5a78-495d-a1ac-acc42d48e35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:15.590747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.591245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.613818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.616209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:15.643570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:15.644645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:15.645908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:15.645908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:15.645908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:15.645908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:15.647892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 225/461] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:15.650678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.653665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.678801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 237/462] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:15.679977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51e52e-5a78-495d-a1ac-acc42d48e35a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.737097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:15.788251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6611c52-622d-4bad-bf67-97edf46d291c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.792430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51e52e-5a78-495d-a1ac-acc42d48e35a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:15.827160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.828548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.828825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.829100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.835252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:15.836195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:15.837307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:15.837924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:15.839483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:15.840011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.842252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.843583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:15.845310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:15.858425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 238/463] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:15.859551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:15.864783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:15.865633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:15.866514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:15.866514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:15.866514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:15.866514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:15.869678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 226/464] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:15.875234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:15.939157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.000446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26966d66-5f7c-4f5a-93c9-ec79dc2c5ad1 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.006648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599fb1c-4578-42c6-98cb-2995f7558be0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.019486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.052644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.053193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc977-58f5-458c-91ea-a68c29f47531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.053886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc977-58f5-458c-91ea-a68c29f47531 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.054170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc977-58f5-458c-91ea-a68c29f47531 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.054447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc977-58f5-458c-91ea-a68c29f47531 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.054738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.055220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffc977-58f5-458c-91ea-a68c29f47531 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.056160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.057069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.057294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffc977-58f5-458c-91ea-a68c29f47531 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.073966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.075595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:16.094923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:16.095879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:16.096856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:16.096856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:16.096856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:16.096856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:16.098660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 239/465] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:16.099713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.154690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 227/466] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:25:15 2022] POST /identity/v3/users => generated 246 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:16.156025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc977-58f5-458c-91ea-a68c29f47531 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.236022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21d6fd-087f-4f77-922d-b46fefc32a47 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.301157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d03d7-8485-498e-8364-43cf76b9c88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.305986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d03d7-8485-498e-8364-43cf76b9c88e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.305986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d03d7-8485-498e-8364-43cf76b9c88e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.305986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d03d7-8485-498e-8364-43cf76b9c88e None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.305986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d03d7-8485-498e-8364-43cf76b9c88e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:16.305986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d03d7-8485-498e-8364-43cf76b9c88e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.308135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d03d7-8485-498e-8364-43cf76b9c88e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.323092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc977-58f5-458c-91ea-a68c29f47531 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.334379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 240/467] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:16.336323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5789-ed49-46cd-a28e-2af543b2c59e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.337771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5789-ed49-46cd-a28e-2af543b2c59e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.338299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5789-ed49-46cd-a28e-2af543b2c59e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.339957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.346310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 241/468] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:16.346310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5789-ed49-46cd-a28e-2af543b2c59e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.371789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e9a60-5e42-4083-8d12-db04126d1611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.372477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e9a60-5e42-4083-8d12-db04126d1611 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.374749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e9a60-5e42-4083-8d12-db04126d1611 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.374749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e9a60-5e42-4083-8d12-db04126d1611 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.374749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e9a60-5e42-4083-8d12-db04126d1611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:16.374749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e9a60-5e42-4083-8d12-db04126d1611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.376236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.376427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e9a60-5e42-4083-8d12-db04126d1611 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.404001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 228/469] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:16.406115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535ac7-c49d-48f4-b8dd-0b44ef280fbc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.406405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535ac7-c49d-48f4-b8dd-0b44ef280fbc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.406710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf535ac7-c49d-48f4-b8dd-0b44ef280fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.427641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-cf535ac7-c49d-48f4-b8dd-0b44ef280fbc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:16.429245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cf535ac7-c49d-48f4-b8dd-0b44ef280fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:16.500275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5789-ed49-46cd-a28e-2af543b2c59e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.527073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 229/470] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:16.528090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf535ac7-c49d-48f4-b8dd-0b44ef280fbc None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.563316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65428ce-9bf4-433d-a12e-6c8723e7be81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.564359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65428ce-9bf4-433d-a12e-6c8723e7be81 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.564648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65428ce-9bf4-433d-a12e-6c8723e7be81 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.565316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65428ce-9bf4-433d-a12e-6c8723e7be81 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.566167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65428ce-9bf4-433d-a12e-6c8723e7be81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.568562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65428ce-9bf4-433d-a12e-6c8723e7be81 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.654619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 242/471] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:25:16 2022] POST /identity/v3/users => generated 248 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:16.655718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65428ce-9bf4-433d-a12e-6c8723e7be81 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.687749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.694501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf535ac7-c49d-48f4-b8dd-0b44ef280fbc None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.745863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d4b02-80ef-4751-aa89-ba893e02df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.746749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d4b02-80ef-4751-aa89-ba893e02df0a None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.747130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d4b02-80ef-4751-aa89-ba893e02df0a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.747613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d4b02-80ef-4751-aa89-ba893e02df0a None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.748402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d4b02-80ef-4751-aa89-ba893e02df0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.749987 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d4b02-80ef-4751-aa89-ba893e02df0a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.775126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:16.797028 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65428ce-9bf4-433d-a12e-6c8723e7be81 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:16.841058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2fcdf-f3d1-48cd-bafb-0ebfc747cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:16.842230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2fcdf-f3d1-48cd-bafb-0ebfc747cfaa None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.842745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2fcdf-f3d1-48cd-bafb-0ebfc747cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.843217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2fcdf-f3d1-48cd-bafb-0ebfc747cfaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.856629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2fcdf-f3d1-48cd-bafb-0ebfc747cfaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:16.858446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2fcdf-f3d1-48cd-bafb-0ebfc747cfaa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-80b2fcdf-f3d1-48cd-bafb-0ebfc747cfaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:16.878761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:16.879696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:16.880548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:16.880548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:16.880548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:16.880548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:16.880548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 243/472] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:16.888096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426cf7-7640-4e73-b590-1a6397bebfc8 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.888415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426cf7-7640-4e73-b590-1a6397bebfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.890291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09426cf7-7640-4e73-b590-1a6397bebfc8 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.890291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 244/473] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:16.891517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09426cf7-7640-4e73-b590-1a6397bebfc8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:16.898176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 230/474] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:25:16 2022] POST /identity/v3/users => generated 248 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:16.899884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0315-c59b-45b3-9032-6aa49d9acc4a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:16.900180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0315-c59b-45b3-9032-6aa49d9acc4a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:16.900445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f0315-c59b-45b3-9032-6aa49d9acc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:16.925031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f99f0315-c59b-45b3-9032-6aa49d9acc4a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:16.926897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f99f0315-c59b-45b3-9032-6aa49d9acc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:17.026095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 231/475] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:17.056283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f0315-c59b-45b3-9032-6aa49d9acc4a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.071890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09426cf7-7640-4e73-b590-1a6397bebfc8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.114933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.123616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.124372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.133482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.133482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.133482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:17.133482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.133482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.145839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 245/476] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:17.152109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.193119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.209915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f0315-c59b-45b3-9032-6aa49d9acc4a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.263102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.263966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.264373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.264738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.265613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.268363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.300106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c7ea31-7cd9-47fb-8a46-7e5f79fa3626 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.303742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.sql.core [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:25:17.303742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:25:17.303742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [parameters: {'id': 'e563e70791524289983861d312a1cd99', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:25:17.303742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80389) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application conn.query(q) May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result.read() May 26 12:25:17.323187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return ref.to_dict() May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:25:17.324725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application next(self.gen) May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application yield resource May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application next(self.gen) May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise self.value May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application session.commit() May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:25:17.325817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.session.flush() May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application compat.raise_( May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:25:17.326727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:25:17.334945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application conn.query(q) May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result.read() May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:25:17.335892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [parameters: {'id': 'e563e70791524289983861d312a1cd99', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:17.337225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 12:25:17.338182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:17.343038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 232/477] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 26 12:25:17 2022] POST /identity/v3/roles => generated 144 bytes in 270 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:17.343038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.367371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404ec59-41f7-40ad-a530-cdcd4dfe7172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.368718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ec59-41f7-40ad-a530-cdcd4dfe7172 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.369343 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ec59-41f7-40ad-a530-cdcd4dfe7172 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.370347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c404ec59-41f7-40ad-a530-cdcd4dfe7172 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.371692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404ec59-41f7-40ad-a530-cdcd4dfe7172 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.373430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c404ec59-41f7-40ad-a530-cdcd4dfe7172 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.457275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 246/478] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:25:17 2022] POST /identity/v3/users => generated 249 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:25:17.504431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257dec1-99d2-442c-b70f-e47bfce1db36 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.557517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905eea0e-6711-428a-85ef-5f5a53969910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.558362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eea0e-6711-428a-85ef-5f5a53969910 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.558675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eea0e-6711-428a-85ef-5f5a53969910 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.559014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905eea0e-6711-428a-85ef-5f5a53969910 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.578383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905eea0e-6711-428a-85ef-5f5a53969910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-905eea0e-6711-428a-85ef-5f5a53969910 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:17.587535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:17.588494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:17.589269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 233/479] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:17.595622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404ec59-41f7-40ad-a530-cdcd4dfe7172 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:17.715848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:17.783468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c404ec59-41f7-40ad-a530-cdcd4dfe7172 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:17.824623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ada42d-75bb-4a11-8a83-3ac467ecf33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:17.825362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada42d-75bb-4a11-8a83-3ac467ecf33f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:17.825647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada42d-75bb-4a11-8a83-3ac467ecf33f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:17.825930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada42d-75bb-4a11-8a83-3ac467ecf33f None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:17.826726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ada42d-75bb-4a11-8a83-3ac467ecf33f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:17.827039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ada42d-75bb-4a11-8a83-3ac467ecf33f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:17.828433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ada42d-75bb-4a11-8a83-3ac467ecf33f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:17.842473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 247/480] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:19.198827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cc17-dc40-4d89-b648-a89354fc2fcc None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.199346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cc17-dc40-4d89-b648-a89354fc2fcc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.199680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5533cc17-dc40-4d89-b648-a89354fc2fcc None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.201860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 234/481] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:19.208698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7aee07-7215-49eb-b1ce-26c43f4397bb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.209197 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7aee07-7215-49eb-b1ce-26c43f4397bb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.209569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7aee07-7215-49eb-b1ce-26c43f4397bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.240508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cb7aee07-7215-49eb-b1ce-26c43f4397bb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:19.241831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cb7aee07-7215-49eb-b1ce-26c43f4397bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:19.344956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 248/482] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:19.380446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533cc17-dc40-4d89-b648-a89354fc2fcc None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.394432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.507494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5533cc17-dc40-4d89-b648-a89354fc2fcc None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.552819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04888f-9de2-472e-ab55-0541e1e5a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.554140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04888f-9de2-472e-ab55-0541e1e5a9ad None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.554618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04888f-9de2-472e-ab55-0541e1e5a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.555534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04888f-9de2-472e-ab55-0541e1e5a9ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.569475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04888f-9de2-472e-ab55-0541e1e5a9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-0d04888f-9de2-472e-ab55-0541e1e5a9ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:19.578457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:19.580744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:19.583418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 235/483] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:19.590327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7aee07-7215-49eb-b1ce-26c43f4397bb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.654072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.766364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7aee07-7215-49eb-b1ce-26c43f4397bb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:19.826030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:19.826745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:19.827029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:19.827302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:19.828060 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:19.828466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:19.830019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:19.843380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 249/484] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:19.851548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04888f-9de2-472e-ab55-0541e1e5a9ad None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:19.938948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:19.971071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04888f-9de2-472e-ab55-0541e1e5a9ad None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.011724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4d67f-d160-4e90-88e1-8498660282b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.012527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d67f-d160-4e90-88e1-8498660282b4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.012808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d67f-d160-4e90-88e1-8498660282b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.013087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d67f-d160-4e90-88e1-8498660282b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.027489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4d67f-d160-4e90-88e1-8498660282b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.028873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4d67f-d160-4e90-88e1-8498660282b4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-a6f4d67f-d160-4e90-88e1-8498660282b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:20.047742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:20.048664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:20.049949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:20.049949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:20.049949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:20.049949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:20.049949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 236/485] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:20.054921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.107951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057a192-cd69-4615-9442-1db043238b4a None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.108282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057a192-cd69-4615-9442-1db043238b4a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.108491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057a192-cd69-4615-9442-1db043238b4a None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.110133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 237/486] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:20.119334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a4db2-1d79-40ce-a380-255a991e6ceb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.119660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a4db2-1d79-40ce-a380-255a991e6ceb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.119882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a4db2-1d79-40ce-a380-255a991e6ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.147564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-381a4db2-1d79-40ce-a380-255a991e6ceb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:20.150188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-381a4db2-1d79-40ce-a380-255a991e6ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:20.245837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.249369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0405a4-cf96-4c93-9727-2c3ed3aef518 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.270429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 238/487] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:20.270979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb4d4-01f3-4c99-9179-19224176d1b2 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.273251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb4d4-01f3-4c99-9179-19224176d1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.273251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afb4d4-01f3-4c99-9179-19224176d1b2 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.273251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 239/488] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:20.292954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c6bc-6d0e-4696-a62a-a9e8423ae084 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.293491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c6bc-6d0e-4696-a62a-a9e8423ae084 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.293979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2c6bc-6d0e-4696-a62a-a9e8423ae084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.305785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.306432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.306742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.307025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.307765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:20.308075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.309462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.321436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-97f2c6bc-6d0e-4696-a62a-a9e8423ae084 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:20.322679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-97f2c6bc-6d0e-4696-a62a-a9e8423ae084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:20.343291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 250/489] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:20.343291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.384309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.422810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 240/490] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:20.424265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2c6bc-6d0e-4696-a62a-a9e8423ae084 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.451425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95b112-62b1-46c0-b709-a859b976f063 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.503304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb960-57f6-4c28-a33a-1ba4dc94409c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.504128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb960-57f6-4c28-a33a-1ba4dc94409c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.504413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb960-57f6-4c28-a33a-1ba4dc94409c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.504691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fb960-57f6-4c28-a33a-1ba4dc94409c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.518622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fb960-57f6-4c28-a33a-1ba4dc94409c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-381fb960-57f6-4c28-a33a-1ba4dc94409c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:20.527440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:20.529728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 251/491] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:20.531773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb960-57f6-4c28-a33a-1ba4dc94409c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.556506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.593089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2c6bc-6d0e-4696-a62a-a9e8423ae084 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.632073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.633459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.633778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.638549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.642117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.643823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.649840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fb960-57f6-4c28-a33a-1ba4dc94409c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:20.661115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:20.663746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 241/492] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:20.666843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.687401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7e39c-2e21-4156-87e1-fdd74bcfbc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.688216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7e39c-2e21-4156-87e1-fdd74bcfbc0e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.688500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7e39c-2e21-4156-87e1-fdd74bcfbc0e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.688781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7e39c-2e21-4156-87e1-fdd74bcfbc0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.701695 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7e39c-2e21-4156-87e1-fdd74bcfbc0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d0f7e39c-2e21-4156-87e1-fdd74bcfbc0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:20.710495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:20.713405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:20.715222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:20.716788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.726572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 252/493] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:20.726572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7e39c-2e21-4156-87e1-fdd74bcfbc0e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.778774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0514fd-d054-41a9-8eae-38746e467e66 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.812929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.816553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.817229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.817509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.817781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.818535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:20.818849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.820285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.833546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 242/494] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:20.833546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.834447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7e39c-2e21-4156-87e1-fdd74bcfbc0e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.876921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7276770-0281-46a8-a616-fe658fedf9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.877594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276770-0281-46a8-a616-fe658fedf9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.877894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276770-0281-46a8-a616-fe658fedf9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.878168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7276770-0281-46a8-a616-fe658fedf9a4 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.879084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276770-0281-46a8-a616-fe658fedf9a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:20.879442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276770-0281-46a8-a616-fe658fedf9a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.880916 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7276770-0281-46a8-a616-fe658fedf9a4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.921058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 253/495] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:20.922394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefc485-fb25-444f-806a-73957cc98556 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.922717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefc485-fb25-444f-806a-73957cc98556 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.922999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebefc485-fb25-444f-806a-73957cc98556 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.924276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 254/496] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:20.924933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefc485-fb25-444f-806a-73957cc98556 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:20.951142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b58f10-e50a-4eb6-ba53-828e18aec782 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:20.954217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:20.987450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786f39a-85a9-400a-a0b2-0c643e5637fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:20.988123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f39a-85a9-400a-a0b2-0c643e5637fd None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:20.988401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f39a-85a9-400a-a0b2-0c643e5637fd None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:20.988680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786f39a-85a9-400a-a0b2-0c643e5637fd None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:20.989411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f39a-85a9-400a-a0b2-0c643e5637fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:20.989714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f39a-85a9-400a-a0b2-0c643e5637fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:20.991117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786f39a-85a9-400a-a0b2-0c643e5637fd None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:20.999573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 243/497] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:21.000864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c2c5-f679-4b83-ad74-7e25de1b8cbf None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.001151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c2c5-f679-4b83-ad74-7e25de1b8cbf None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.001429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c2c5-f679-4b83-ad74-7e25de1b8cbf None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.002674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 244/498] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:21.003363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c2c5-f679-4b83-ad74-7e25de1b8cbf None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.048009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebefc485-fb25-444f-806a-73957cc98556 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.085013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6ccdd-f03a-4333-a8df-1c8c983598ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.086802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6ccdd-f03a-4333-a8df-1c8c983598ff None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.087472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6ccdd-f03a-4333-a8df-1c8c983598ff None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.087472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6ccdd-f03a-4333-a8df-1c8c983598ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.094638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.098662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6ccdd-f03a-4333-a8df-1c8c983598ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.100150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6ccdd-f03a-4333-a8df-1c8c983598ff None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-33e6ccdd-f03a-4333-a8df-1c8c983598ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:21.120229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:21.121172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:21.122009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:21.122009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:21.122009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.122009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:21.122009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 255/499] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:21.122277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c2c5-f679-4b83-ad74-7e25de1b8cbf None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.122728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969f2a-d549-4941-9e5f-27dd07d50535 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.123001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969f2a-d549-4941-9e5f-27dd07d50535 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.123286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0969f2a-d549-4941-9e5f-27dd07d50535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.142741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d0969f2a-d549-4941-9e5f-27dd07d50535 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:21.144001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d0969f2a-d549-4941-9e5f-27dd07d50535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:21.158899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9ee33-a682-40a4-9b4c-90aa64519920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.159543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ee33-a682-40a4-9b4c-90aa64519920 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.159818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ee33-a682-40a4-9b4c-90aa64519920 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.160087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9ee33-a682-40a4-9b4c-90aa64519920 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.199760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.218919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 256/500] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:21.220158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969f2a-d549-4941-9e5f-27dd07d50535 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.245691 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ee33-a682-40a4-9b4c-90aa64519920 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.247481 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9ee33-a682-40a4-9b4c-90aa64519920 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.357585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0969f2a-d549-4941-9e5f-27dd07d50535 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.359310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 245/501] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:21.360601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0969b-db19-41ce-98c4-41aafabbf92a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.360890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0969b-db19-41ce-98c4-41aafabbf92a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.361161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0969b-db19-41ce-98c4-41aafabbf92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.379953 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.380171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-20b0969b-db19-41ce-98c4-41aafabbf92a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:21.386643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-20b0969b-db19-41ce-98c4-41aafabbf92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:21.396292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.397107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.397386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.397655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.409199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.410683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:21.428782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:21.430011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:21.431368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:21.431368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:21.431368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.431368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:21.431368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 257/502] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:21.431368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.447727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.455311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 246/503] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:21.456133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0969b-db19-41ce-98c4-41aafabbf92a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.561972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0969b-db19-41ce-98c4-41aafabbf92a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.577010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef68c-58a6-40b7-850d-369fabb30673 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.601237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f577a3-b84c-4e54-b52b-f7e20f1d57df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.602084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f577a3-b84c-4e54-b52b-f7e20f1d57df None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.602358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f577a3-b84c-4e54-b52b-f7e20f1d57df None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.602663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f577a3-b84c-4e54-b52b-f7e20f1d57df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.612570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.613160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.613272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f577a3-b84c-4e54-b52b-f7e20f1d57df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:21.613466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.613739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.614459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:21.614795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.616164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-73f577a3-b84c-4e54-b52b-f7e20f1d57df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:21.621415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:21.622591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:21.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 247/504] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:21.624620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f577a3-b84c-4e54-b52b-f7e20f1d57df None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.634423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 258/505] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:21.634423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.664746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.687642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.732949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f577a3-b84c-4e54-b52b-f7e20f1d57df None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.736940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0659811-ed1b-4fd9-8eaf-49ef60a98be1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.769472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.770563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.770839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.771113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.772868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.773579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.773877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.774145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.774986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:21.775291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.776663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.783161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.784616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.788117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 259/506] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:21.788932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:21.803422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:21.804400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:21.805886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:21.805886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:21.805886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.805886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:21.805886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 248/507] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:21.806334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.905653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.915326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941c611d-cec5-4fe8-aed9-ec6ae909d1ef None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.925728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0718342-9dcd-45fa-84a7-61267aecd9af None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:21.935630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:21.954206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.955051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.955339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.955616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.961180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:21.962379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:21.962686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:21.962948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:21.963787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:21.964017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.965403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.967876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:21.969457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:21.974997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 249/508] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:21.975176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:21.990958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:21.991869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:21.993322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:21.993322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:21.993322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:21.993322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:21.993322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 260/509] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:21.993322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.084350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592b5fb-94d9-4f70-9743-e6dd813c5acb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.108938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dcc431-b9e0-4bb0-89bc-bd27b78ce091 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.120210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.121018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.121298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.121570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.129951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.131435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.143969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.144798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.145345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.145800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:22.147509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:22.148507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:22.150154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 250/510] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:22.151208 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.155157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.156738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:22.172849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:22.173821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:22.174736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 261/511] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:22.175293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.179299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.187621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.266364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf09c5b-ba12-47ec-b399-36de0087d741 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.290210 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439880ce-e4e7-41ea-a6be-13e7857561f0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.301451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.302111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.302386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.302689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.303398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.303697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.305601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.317622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 251/512] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:22.318352 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.338105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.339086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.339244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.339482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.350440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.352471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:22.371651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:22.373004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:22.374163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:22.374163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:22.374163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:22.374163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:22.374163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 262/513] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:22.374163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.426125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.435754 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.435902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685195c-4d80-4611-a780-6477e382d17a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.473487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.474150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.474426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.474804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.475517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.475816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.477681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.479751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612847dc-bf7e-459f-ba38-2a5f2bdfad2b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.492982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 252/514] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:22.494058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.523221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.524908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.524908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.524908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.525546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.525852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.527351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.546277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 263/515] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:22.547134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.610986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dac74-b2e2-4300-9290-6b1c3c42bcfc None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.654113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.655388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.655847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.656312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.656659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6779999-a087-43bf-9ff0-b3f7c84fc232 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.657897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.658441 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.660264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.673033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.695792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.696548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.696839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.697109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.700702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 253/516] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:22.701661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.704748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.706365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.713587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:22.722999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:22.724083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:22.724991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 264/517] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:22.725912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.822818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c41a301-6497-437e-a0fc-2243fa63b535 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.845052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead0a7-a637-40e1-b890-95e361d15368 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:22.865650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.866313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.866617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.866894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.868266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:22.868503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.869867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.881394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 254/518] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:22.882306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:22.883102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2b17c-0a0f-4fd8-9a0f-a4529c377b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:22.883997 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b17c-0a0f-4fd8-9a0f-a4529c377b10 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:22.884472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b17c-0a0f-4fd8-9a0f-a4529c377b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:22.884942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd2b17c-0a0f-4fd8-9a0f-a4529c377b10 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:22.885664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2b17c-0a0f-4fd8-9a0f-a4529c377b10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:22.887197 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd2b17c-0a0f-4fd8-9a0f-a4529c377b10 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:22.961131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:22.983700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 265/519] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:25:22 2022] POST /identity/v3/users => generated 247 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:22.984351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2b17c-0a0f-4fd8-9a0f-a4529c377b10 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.004390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3d918-78b3-4fbd-8df9-681e9c1c6905 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.021281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.060832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4208ef-6fec-49ce-b549-cc4e1644f754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.061514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4208ef-6fec-49ce-b549-cc4e1644f754 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.061798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4208ef-6fec-49ce-b549-cc4e1644f754 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.062070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4208ef-6fec-49ce-b549-cc4e1644f754 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.117602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd2b17c-0a0f-4fd8-9a0f-a4529c377b10 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.153941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4208ef-6fec-49ce-b549-cc4e1644f754 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.155598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4208ef-6fec-49ce-b549-cc4e1644f754 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.175955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c3019-4e0d-4317-87f7-6f2079ed03a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.177009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3019-4e0d-4317-87f7-6f2079ed03a5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.177517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3019-4e0d-4317-87f7-6f2079ed03a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.178006 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1c3019-4e0d-4317-87f7-6f2079ed03a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.239626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.268822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c3019-4e0d-4317-87f7-6f2079ed03a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.270570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1c3019-4e0d-4317-87f7-6f2079ed03a5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.290582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 255/520] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:23.290582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4208ef-6fec-49ce-b549-cc4e1644f754 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.317650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.404214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 266/521] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:23.405293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c3019-4e0d-4317-87f7-6f2079ed03a5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.421557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4208ef-6fec-49ce-b549-cc4e1644f754 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.461783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.462686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.462972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.463246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.463246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:23.463246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.463246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.491134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 256/522] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:23.491134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.523076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.528344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1c3019-4e0d-4317-87f7-6f2079ed03a5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.560302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.567468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.568470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.568752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.569028 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.578326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.579838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:23.596857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:23.597859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:23.599274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 267/523] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:23.604194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.614790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5aec66-819e-4b36-8a25-f150dcf6407e None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.666475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.666962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.667249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.667516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.679169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.681598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:23.702582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:23.703614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:23.704666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:23.704666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:23.704666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:23.704666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:23.711823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 257/524] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:23.711823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.740040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4e4f3d-938f-4d45-8f8c-db09b4227abf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.788159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.790135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.791302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.791775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.809713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.812267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.822732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:23.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:23.837439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:23.838473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:23.838473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:23.838473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:23.838473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:23.844142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 268/525] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:23.844142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.851060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cd3775-7815-4733-8431-dd06963c78c0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:23.887329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:23.888164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:23.888892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:23.889265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:23.889967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:23.890815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=5643e9f777c94d06a2f5c687dd8919b6) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:23.891193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:23.893074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:23.910557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 258/526] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/role_assignments?user.id=5643e9f777c94d06a2f5c687dd8919b6&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:23.910557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:23.977778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0237cf2b-08d9-4488-9a6b-d880b56c5520 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.019206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.020105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.020388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.020660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.021523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.021836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.023340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.046976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebd92e-d06f-42fc-9582-9c35cb2cb7ff None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.050488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 269/527] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:24.051358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.088421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.089735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.090310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.090826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.091775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.092476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.094247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.109341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 259/528] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:24.110519 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.115101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.174960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.178285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75d551-8e07-4d84-b584-7ed28f29036f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.233974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.234843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.235231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.235628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.236741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.237148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.239486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.243439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4bceb8-a566-408b-8547-2f26025050e8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.262574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 270/529] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:24.262574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.310683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39426-da60-467e-9e04-8f9a3cc07b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.311785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39426-da60-467e-9e04-8f9a3cc07b0f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.312208 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39426-da60-467e-9e04-8f9a3cc07b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.312625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f39426-da60-467e-9e04-8f9a3cc07b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.397002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf35316-645e-4a43-a3e4-86ee9911700f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.410846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39426-da60-467e-9e04-8f9a3cc07b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.412628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f39426-da60-467e-9e04-8f9a3cc07b0f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.417079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.446478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.447534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.447939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.448308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.461867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.462648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:24.485062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:24.486014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:24.486974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 271/530] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:24.488173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.518918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.566889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 260/531] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:24.568615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39426-da60-467e-9e04-8f9a3cc07b0f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.645430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8d2f9-9a10-44d4-a0f9-529eb823b1fe None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.692016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.693494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.694127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.694624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.703887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f39426-da60-467e-9e04-8f9a3cc07b0f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.706015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.707301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.708018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:24.730088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:24.734689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 272/532] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:24.735512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.756727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.757582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.758151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.758504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.759679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.760057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.762191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 261/533] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:24.779007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.845540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:24.875227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584320c8-0853-4d50-9fd7-d271ea641e24 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.927375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.927887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90561d8b-8f90-43cc-86e7-d28466573f88 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:24.928686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.929123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.929774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.947172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.948783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:24.970798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:24.971894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:24.972781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:24.972781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:24.972781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:24.972781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:24.977510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 273/534] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:24.979073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:24.981060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:24.982281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:24.982777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:24.984226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:24.985171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:24.985619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:24.987244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.017384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 262/535] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.018352 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.052003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.109626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51549a50-aaec-4364-9964-7af1ead2d5e3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.142942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.149923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.150850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.151301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.151896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.152922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=17335764c3fd4960ab969211ca353b75) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.153414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.154113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f6e62-d9d8-493d-8fe6-6de241f4c774 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.155284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.161877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 274/536] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:24 2022] GET /identity/v3/role_assignments?user.id=17335764c3fd4960ab969211ca353b75&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.162919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.204610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.205282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.205559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.205833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.206839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.207185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.209430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.228734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 263/537] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.237463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.332899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c49de-6bec-40f5-95d7-fd00a3f2cf17 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.384036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc96187-54e5-4d13-8b1f-796ff2794e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.385021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96187-54e5-4d13-8b1f-796ff2794e3d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.385453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96187-54e5-4d13-8b1f-796ff2794e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.385871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc96187-54e5-4d13-8b1f-796ff2794e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.386917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc96187-54e5-4d13-8b1f-796ff2794e3d None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=175b409f5ee842ddb9f5f3468a6a461b) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.387416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc96187-54e5-4d13-8b1f-796ff2794e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.389463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc96187-54e5-4d13-8b1f-796ff2794e3d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.396666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 275/538] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/role_assignments?user.id=175b409f5ee842ddb9f5f3468a6a461b&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.442058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.468283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4413f7-2d27-4468-994b-a8b55604e1cb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.526609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.527992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.528490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.528977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.542281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.543873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:25.570699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:25.572476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:25.573338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 264/539] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:25.578123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611f5d-8a98-4674-9a89-a9496c8fd53c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.578782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611f5d-8a98-4674-9a89-a9496c8fd53c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.578782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db611f5d-8a98-4674-9a89-a9496c8fd53c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.580565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 276/540] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:25.587434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.587858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc6deb-ec7c-4388-a6cc-95806693c4f7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.588457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc6deb-ec7c-4388-a6cc-95806693c4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.588933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc6deb-ec7c-4388-a6cc-95806693c4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.618784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c9cc6deb-ec7c-4388-a6cc-95806693c4f7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:25.620811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c9cc6deb-ec7c-4388-a6cc-95806693c4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:25.716781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6cefa-ea89-4b7c-81f7-ab1253c26d77 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:25.748529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.778087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:25.779163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:25.779650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:25.780203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:25.780309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 277/541] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:25.781840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:25.782379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:25.785040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:25.803118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 265/542] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:25.809345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc6deb-ec7c-4388-a6cc-95806693c4f7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.825759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:25.832829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:25.967581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc6deb-ec7c-4388-a6cc-95806693c4f7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.009706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.010622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.010900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.011170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.012010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=ab54d18d265a42ce9e341e59c57d4625) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:26.012319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.013833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.020624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 278/543] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/role_assignments?user.id=ab54d18d265a42ce9e341e59c57d4625&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:26.021302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f83a68-d03c-478a-ac74-c0064d322bea None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.093685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935becf2-b603-4edb-a968-c08e76ea78ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.094563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935becf2-b603-4edb-a968-c08e76ea78ff None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.094846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935becf2-b603-4edb-a968-c08e76ea78ff None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.095123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935becf2-b603-4edb-a968-c08e76ea78ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.112533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935becf2-b603-4edb-a968-c08e76ea78ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-935becf2-b603-4edb-a968-c08e76ea78ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:26.120751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:26.121668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:26.122586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 266/544] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:26.130038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.212359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:26.268165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676517e2-264f-4560-b8ff-d8ac9151f3eb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.323912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.324763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.325056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.325334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.326118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:26.326429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.328541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.341003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 279/545] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:26.346564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935becf2-b603-4edb-a968-c08e76ea78ff None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.457723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:26.523975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935becf2-b603-4edb-a968-c08e76ea78ff None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.563959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245f58b-83f1-4917-bcff-14eb84f6c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.565088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245f58b-83f1-4917-bcff-14eb84f6c568 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.565510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245f58b-83f1-4917-bcff-14eb84f6c568 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.565924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245f58b-83f1-4917-bcff-14eb84f6c568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.584797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245f58b-83f1-4917-bcff-14eb84f6c568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.587132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5245f58b-83f1-4917-bcff-14eb84f6c568 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-5245f58b-83f1-4917-bcff-14eb84f6c568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:26.612725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:26.613728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:26.615223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:26.615223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:26.615223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:26.615223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:26.617270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 267/546] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:26.623737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.726152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc827f-5be9-40e6-b528-bae897ba72f8 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.727618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc827f-5be9-40e6-b528-bae897ba72f8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.728349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc827f-5be9-40e6-b528-bae897ba72f8 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.732178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 268/547] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:26.741001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc7f22-5fd7-470d-8789-547538f1468d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.741776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc7f22-5fd7-470d-8789-547538f1468d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.742572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc7f22-5fd7-470d-8789-547538f1468d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.773115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4fcc7f22-5fd7-470d-8789-547538f1468d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:26.775092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4fcc7f22-5fd7-470d-8789-547538f1468d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:26.796048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3afd32-b6d6-42d3-8867-557cddf9ce2e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:26.833426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:26.875212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:26.875894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:26.876178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:26.876455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:26.877189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:26.877503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:26.878896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:26.905604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 280/548] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:26.911500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:26.934348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 269/549] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:26.970491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc7f22-5fd7-470d-8789-547538f1468d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:27.063133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:27.106339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bbcf7-8bc0-40b9-a560-3a5c1ad34e86 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:27.153632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:27.154463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:27.154778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:27.155058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:27.163700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:27.165549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:27.169337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc7f22-5fd7-470d-8789-547538f1468d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:27.188691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:27.190248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:27.192481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:27.196142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 281/550] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:27.204764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:27.265859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace1da8-ff45-4292-8199-dfe4f881417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:27.266747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1da8-ff45-4292-8199-dfe4f881417d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:27.267037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1da8-ff45-4292-8199-dfe4f881417d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:27.267313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ace1da8-ff45-4292-8199-dfe4f881417d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:27.278901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:27.295241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ace1da8-ff45-4292-8199-dfe4f881417d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-7ace1da8-ff45-4292-8199-dfe4f881417d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:27.311221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:27.312372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:27.313353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:27.316359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 270/551] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:27.322971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace1da8-ff45-4292-8199-dfe4f881417d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:27.415263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697836e-eae8-424a-a3e4-1522889cd597 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:27.458303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:27.459012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:27.459300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:27.459579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:27.462488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:27.462825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:27.464270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:27.506103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 282/552] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 26 12:25:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:27.511683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:27.562074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ace1da8-ff45-4292-8199-dfe4f881417d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:27.578468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:27.643328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:27.645115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:27.645602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:27.646092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:27.647082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:27.647605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:27.649754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:27.669973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 271/553] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:27.678898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:27.680557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:27.687246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce08ca42-cab1-41d3-84ff-bec7438b7b5a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:27.728965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7ac45-bdb1-40d3-8196-76ee038138d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:27.729696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7ac45-bdb1-40d3-8196-76ee038138d0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:27.730033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7ac45-bdb1-40d3-8196-76ee038138d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:27.730479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7ac45-bdb1-40d3-8196-76ee038138d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:27.806640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7ac45-bdb1-40d3-8196-76ee038138d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:27.809328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7ac45-bdb1-40d3-8196-76ee038138d0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:27.921775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15a80e-cc40-4532-90b7-58c7781c07f6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:27.922886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:27.926886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 283/554] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:27.928256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7ac45-bdb1-40d3-8196-76ee038138d0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:27.961549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:27.962787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:27.963343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:27.963848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:27.975627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:27.978873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:28.000761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:28.001918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:28.002899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:28.002899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:28.002899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:28.002899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:28.006009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 272/555] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:28.012967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.055620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.070359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7ac45-bdb1-40d3-8196-76ee038138d0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.168547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d4e16-98d3-4fa7-bc51-b7cf64bcaf7c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.192800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.193525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.193803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.194073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.215848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.217291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:28.245786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:28.246755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:28.248346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:28.248346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:28.248346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:28.248346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:28.248578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 284/556] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:28.255661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.259290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.260112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.260393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.260667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.261400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:28.261703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.263115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.296565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 273/557] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:28.303624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.313327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.437137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313704a-729d-45fb-b6db-5d0486086cc2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.472529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.494751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b3069-66c1-479d-814c-3f390fcb24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.495438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3069-66c1-479d-814c-3f390fcb24ef None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.496962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3069-66c1-479d-814c-3f390fcb24ef None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.497545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b3069-66c1-479d-814c-3f390fcb24ef None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.498289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b3069-66c1-479d-814c-3f390fcb24ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:28.498621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b3069-66c1-479d-814c-3f390fcb24ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.500828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b3069-66c1-479d-814c-3f390fcb24ef None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.502977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac044-04c9-4fc9-b041-ed90ddbb04e6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.522441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 285/558] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:28.524543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4139-c1ae-4b4f-ba80-4a6d301d3034 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.524831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4139-c1ae-4b4f-ba80-4a6d301d3034 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.525105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e4139-c1ae-4b4f-ba80-4a6d301d3034 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.526625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 286/559] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:28.529202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e4139-c1ae-4b4f-ba80-4a6d301d3034 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.559895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbad392-d07e-4a50-a828-f4cb85465e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.560698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad392-d07e-4a50-a828-f4cb85465e59 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.561025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad392-d07e-4a50-a828-f4cb85465e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.561303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbad392-d07e-4a50-a828-f4cb85465e59 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.569184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbad392-d07e-4a50-a828-f4cb85465e59 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.571627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbad392-d07e-4a50-a828-f4cb85465e59 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-2fbad392-d07e-4a50-a828-f4cb85465e59 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:28.588586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:28.589612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 274/560] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58054-03f3-4796-addb-560ed6552ce0 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58054-03f3-4796-addb-560ed6552ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.596241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d58054-03f3-4796-addb-560ed6552ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.609089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-66d58054-03f3-4796-addb-560ed6552ce0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:28.610297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-66d58054-03f3-4796-addb-560ed6552ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:28.653563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e4139-c1ae-4b4f-ba80-4a6d301d3034 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.663132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.692321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294742f-b151-41ac-bf7d-ec43824b8075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.693182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 275/561] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:28.694577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4d2f-a693-4bcc-9a1a-ea710496f5a6 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.694944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4d2f-a693-4bcc-9a1a-ea710496f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.695197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a4d2f-a693-4bcc-9a1a-ea710496f5a6 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.696539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294742f-b151-41ac-bf7d-ec43824b8075 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.697059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294742f-b151-41ac-bf7d-ec43824b8075 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.697633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294742f-b151-41ac-bf7d-ec43824b8075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.701351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 276/562] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:28.702414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a4d2f-a693-4bcc-9a1a-ea710496f5a6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.710111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294742f-b151-41ac-bf7d-ec43824b8075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.713086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294742f-b151-41ac-bf7d-ec43824b8075 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4294742f-b151-41ac-bf7d-ec43824b8075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:28.741147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:28.743056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:28.744380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:28.744380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:28.744380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:28.744380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:28.744380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:28.744380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:28.744380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:28.744380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:28.755124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 287/563] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:28.755124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aac7ae-3ebd-4c72-9038-8e3825999c53 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.755124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aac7ae-3ebd-4c72-9038-8e3825999c53 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.755124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aac7ae-3ebd-4c72-9038-8e3825999c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.768377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-58aac7ae-3ebd-4c72-9038-8e3825999c53 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:28.769880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-58aac7ae-3ebd-4c72-9038-8e3825999c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:28.797336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.834032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a4d2f-a693-4bcc-9a1a-ea710496f5a6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:28.849930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 288/564] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:28.850884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aac7ae-3ebd-4c72-9038-8e3825999c53 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.878571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:28.879555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:28.879831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:28.880106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:28.880946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:28.881249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:28.882727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:28.903734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 277/565] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:28.904763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:28.978351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:28.984251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aac7ae-3ebd-4c72-9038-8e3825999c53 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.016834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c827303-6e53-40f9-8d71-737c8b3f4767 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.021889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5677afe-7657-4508-91bc-00053e74a8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.022748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5677afe-7657-4508-91bc-00053e74a8ac None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.023026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5677afe-7657-4508-91bc-00053e74a8ac None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.023820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5677afe-7657-4508-91bc-00053e74a8ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.034308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5677afe-7657-4508-91bc-00053e74a8ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b5677afe-7657-4508-91bc-00053e74a8ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:29.043567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:29.044637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:29.045476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 289/566] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:29.046165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5677afe-7657-4508-91bc-00053e74a8ac None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.050365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.058847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.059583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.059858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.060125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.060905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.061208 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.062664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.075402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 278/567] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:29.076280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.152525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5677afe-7657-4508-91bc-00053e74a8ac None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.180251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80956401-ddfc-407f-a7a9-44bcdca4609f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.187009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b53a96f-1ba3-4427-a2aa-fb67889ba736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.187892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a96f-1ba3-4427-a2aa-fb67889ba736 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.188168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a96f-1ba3-4427-a2aa-fb67889ba736 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.188439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b53a96f-1ba3-4427-a2aa-fb67889ba736 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.199440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b53a96f-1ba3-4427-a2aa-fb67889ba736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8b53a96f-1ba3-4427-a2aa-fb67889ba736 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:29.207209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:29.208307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:29.209352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 290/568] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:29.210177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b89ee-c15e-47f1-91c5-bafcfd044249 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.210177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b89ee-c15e-47f1-91c5-bafcfd044249 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.210177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b89ee-c15e-47f1-91c5-bafcfd044249 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.212107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 291/569] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:29.214692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b89ee-c15e-47f1-91c5-bafcfd044249 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.223690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.224549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.224776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.225050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.237055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.237973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.239863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:29.259159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:29.260102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:29.260989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:29.260989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:29.260989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:29.260989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:29.260989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 279/570] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:29.261695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.307885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.337909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b89ee-c15e-47f1-91c5-bafcfd044249 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.416609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1af7b-af4a-48dd-84e7-b9b23a1cf04f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.417506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.418224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.418467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.418849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.419606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.419917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.421290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.430380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 292/571] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:29.431205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.453881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba66cc8b-4a65-428a-9327-f4bf8b30caed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.454553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66cc8b-4a65-428a-9327-f4bf8b30caed None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.454847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66cc8b-4a65-428a-9327-f4bf8b30caed None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.455118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba66cc8b-4a65-428a-9327-f4bf8b30caed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.455938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66cc8b-4a65-428a-9327-f4bf8b30caed None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=df88788d6691436c983cdb53f5e4c53e) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.456243 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66cc8b-4a65-428a-9327-f4bf8b30caed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.457680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba66cc8b-4a65-428a-9327-f4bf8b30caed None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.465056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 280/572] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/role_assignments?user.id=df88788d6691436c983cdb53f5e4c53e&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:29.467029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a82b2c-845b-4736-af4d-e094c515e847 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.467320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a82b2c-845b-4736-af4d-e094c515e847 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.467600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a82b2c-845b-4736-af4d-e094c515e847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.486996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-75a82b2c-845b-4736-af4d-e094c515e847 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:29.488220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-75a82b2c-845b-4736-af4d-e094c515e847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:29.538341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.566041 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923f1b-0cc9-467f-aac4-e23025320ba3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.584260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 281/573] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:29.584260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a82b2c-845b-4736-af4d-e094c515e847 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.634556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.637432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.638873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.639370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.639857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.641233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.641882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.644758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.658736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 293/574] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:29.659899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.732374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a82b2c-845b-4736-af4d-e094c515e847 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.777438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.778347 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.778816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.779270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.780432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:29.780642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.782123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.786614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18495275-c092-4eeb-a0db-e9bb507462ae None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.800063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 282/575] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:29.800063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.837477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.838314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.838627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.838899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.849177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.852571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:29.854022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:29.877250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:29.878592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:29.879657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:29.879657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:29.879657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:29.879657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:29.879657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 294/576] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:29.881363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:29.940034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:29.947103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870742-1075-4ad1-af8b-35d13bed2186 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:29.985577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff0922-75f4-4da1-bd86-42c7c77c0c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:29.986386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff0922-75f4-4da1-bd86-42c7c77c0c04 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:29.986697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff0922-75f4-4da1-bd86-42c7c77c0c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:29.986976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff0922-75f4-4da1-bd86-42c7c77c0c04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:29.998878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff0922-75f4-4da1-bd86-42c7c77c0c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:30.004229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6cbe5-b5ee-4b9a-a2a5-c7350b1ac345 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c5ff0922-75f4-4da1-bd86-42c7c77c0c04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:30.006710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:30.008120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:30.008986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 283/577] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:30.010043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff0922-75f4-4da1-bd86-42c7c77c0c04 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.049721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.050985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.051475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.051932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.068736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.071082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:30.094440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:30.095541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:30.096428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:30.096428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:30.096428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:30.096428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:30.096428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 295/578] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:30.097087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.128020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff0922-75f4-4da1-bd86-42c7c77c0c04 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.156527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:30.169804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.170656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.170936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.171209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.178178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.179690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:30.194551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:30.196728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 284/579] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:30.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.216427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:30.224359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0b10d-f7a6-4389-912a-7674b41da092 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.273160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.274511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.275314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.275662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.276464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:30.276838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.278300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.292010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 296/580] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:30.297303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.325740 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd73a2c-92b3-4aad-b1e8-86a3c0a9fa49 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.369872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.370645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.370924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.371190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.371934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:30.372234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.373594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.383409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 285/581] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:30.384301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.437356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce75da9-5593-408b-922d-f1e7d3245a14 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.440133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:30.478859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:30.479186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.479862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.480147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.480420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.481273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:30.481586 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.483089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.503450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 297/582] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:30.503450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.509999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d422c2-0211-4226-b18b-0b00c9a070a2 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.550285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.551106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.551459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.551808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.552682 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:30.552992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.554981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.568000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 286/583] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:30.568647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.639553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084ed54-6d5a-47f5-86e2-1e4aeba12d59 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.678369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.679792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.680070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.680345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.689000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.690459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.692919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a435f74-18ec-46c0-b436-fbacacd824c2 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:30.705303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:30.706378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 298/584] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:30.707349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.735053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:30.739643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.740449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.740730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.741010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.744037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:30.755267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.757092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:30.777666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:30.789587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:30.790882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:30.790882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:30.790882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:30.790882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:30.790882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 287/585] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:30.790882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.828203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c4dd3-6a0e-4694-abb3-e36347647114 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.869566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.870399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.870717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.870978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] PATH_INFO: `/v3/users/glance` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.879251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.880725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:30.897404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:30.899004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:30.899958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 299/586] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:30.901178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:30.907902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364487ed-da56-40e0-93b1-d3e57e81530c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:30.944115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af462c-16f0-4d3f-9cea-0f1555be57b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:30.945625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af462c-16f0-4d3f-9cea-0f1555be57b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:30.946079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af462c-16f0-4d3f-9cea-0f1555be57b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:30.946456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af462c-16f0-4d3f-9cea-0f1555be57b2 None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/5643e9f777c94d06a2f5c687dd8919b6/roles/d1ec8d970c824de78ea63e57d8720241` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:30.966136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af462c-16f0-4d3f-9cea-0f1555be57b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=5643e9f777c94d06a2f5c687dd8919b6, role_id=d1ec8d970c824de78ea63e57d8720241)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:30.968081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af462c-16f0-4d3f-9cea-0f1555be57b2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:30.994442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.010835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb498b3-cb64-4126-aee5-d82c613b987a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.040598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 288/587] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:25:30 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/5643e9f777c94d06a2f5c687dd8919b6/roles/d1ec8d970c824de78ea63e57d8720241 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:31.041734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af462c-16f0-4d3f-9cea-0f1555be57b2 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.057692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.058825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.059311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.059873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.061151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:31.061729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.063653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.090646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 300/588] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 26 12:25:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:31.092429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.103402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.196782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af462c-16f0-4d3f-9cea-0f1555be57b2 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.241295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.242624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.243638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.243913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.244661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:31.244970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.246390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.268564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 289/589] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:31.269834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.327122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49ee7-1ca5-45b0-8db4-eac3aac6720e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.375341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.376856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.377146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.377465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.378735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:31.379058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.380900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.404783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.405433 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.409631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 301/590] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:31.410110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e14a0e-9161-4753-8d90-09ec70dcfebb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.414945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.454024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b097928-38cd-4543-872a-66054beca37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.455008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097928-38cd-4543-872a-66054beca37e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.456463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097928-38cd-4543-872a-66054beca37e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.457548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b097928-38cd-4543-872a-66054beca37e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.475533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b097928-38cd-4543-872a-66054beca37e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.477764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b097928-38cd-4543-872a-66054beca37e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-7b097928-38cd-4543-872a-66054beca37e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:31.504457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:31.505757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:31.506852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:31.506852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:31.506852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:31.506852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:31.514384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 290/591] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:31.514384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b097928-38cd-4543-872a-66054beca37e None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.552940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c93dac6-2a19-49cd-9efb-f1f6b34730cb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.606879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.608015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.608442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.608860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.620709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.622457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:31.644022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:31.645457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:25:31.646638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:31.649544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 302/592] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:31.650544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.656205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b097928-38cd-4543-872a-66054beca37e None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.708802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.710261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.711865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.712336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.723498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.735640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.737530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:31.759908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:31.761285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:31.762797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:31.762797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:31.762797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:31.762797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:31.762797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 291/593] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:31.766499 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.769846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:31.785772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1e8f42-f47b-41c7-a5d7-60b7824097a1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.839168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.840619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.841071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.841498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.842380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:31.842863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.844383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.862288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 303/594] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:31.863405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:31.897113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90763323-26f9-4145-af80-a27922a0da92 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:31.949728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a62087-e0e2-483d-916b-3b67a8511777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:31.950412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62087-e0e2-483d-916b-3b67a8511777 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.950717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62087-e0e2-483d-916b-3b67a8511777 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.950997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a62087-e0e2-483d-916b-3b67a8511777 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.951829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a62087-e0e2-483d-916b-3b67a8511777 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:31.952148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a62087-e0e2-483d-916b-3b67a8511777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:31.953615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a62087-e0e2-483d-916b-3b67a8511777 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:31.973804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 292/595] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:31.975084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead1de-f741-468f-941a-a0fab6720272 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:31.975368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead1de-f741-468f-941a-a0fab6720272 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:31.975641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aead1de-f741-468f-941a-a0fab6720272 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:31.982590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 293/596] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:31.982590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead1de-f741-468f-941a-a0fab6720272 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.038617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cb17c-f973-4999-a657-61b5228c6df8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.055624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.067607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.088156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.088833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.089112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.089384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.090251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:32.090404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.091841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.100569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aead1de-f741-468f-941a-a0fab6720272 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.106238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 304/597] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:32.108085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.155298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e8b7f-7648-4f65-aba0-1fcbb0b992eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.156587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8b7f-7648-4f65-aba0-1fcbb0b992eb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.157031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8b7f-7648-4f65-aba0-1fcbb0b992eb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.157481 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e8b7f-7648-4f65-aba0-1fcbb0b992eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.171878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e8b7f-7648-4f65-aba0-1fcbb0b992eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.174239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e8b7f-7648-4f65-aba0-1fcbb0b992eb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b84e8b7f-7648-4f65-aba0-1fcbb0b992eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:32.197524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:32.198491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:32.199876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:32.199876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:32.199876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:32.199876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:32.199876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:32.199876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:32.199876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:32.199876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:32.206615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 294/598] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:32.208289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb589-a996-4e22-b1b3-a43e0abb6315 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.208746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb589-a996-4e22-b1b3-a43e0abb6315 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.209190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbb589-a996-4e22-b1b3-a43e0abb6315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.234174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-00dbb589-a996-4e22-b1b3-a43e0abb6315 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:32.236039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-00dbb589-a996-4e22-b1b3-a43e0abb6315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:32.266180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee2d85-7baa-41a6-b297-3ab21e5c0623 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.309186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.310027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.310310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.310632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.323334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.324790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.346874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 295/599] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:32.346874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbb589-a996-4e22-b1b3-a43e0abb6315 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:32.347187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:32.348211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:32.349370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:32.349370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:32.349370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:32.349370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:32.349370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 305/600] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:32.349370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.388132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.405477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.463262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dbb589-a996-4e22-b1b3-a43e0abb6315 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.481406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb51af-207a-43d3-9dc6-32d78f8a9f71 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.503961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.504695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.504996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.505284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.513508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.514999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:32.533031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:32.533979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:32.534918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 296/601] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:32.536074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.542078 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.543182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.543505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.543792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.544600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:32.545107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.546638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.567248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 306/602] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:32.568119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.663832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f727977-1c22-4e3b-80b8-8334c55c52e5 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.677322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.678387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:32.687571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa5933-f464-41bf-804e-abacdac52045 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.703815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b19844-2678-490f-b191-e00426829b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.704485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19844-2678-490f-b191-e00426829b95 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.704765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19844-2678-490f-b191-e00426829b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.705040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b19844-2678-490f-b191-e00426829b95 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.705758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b19844-2678-490f-b191-e00426829b95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:32.706062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b19844-2678-490f-b191-e00426829b95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.707503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b19844-2678-490f-b191-e00426829b95 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.728478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 297/603] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:32.728478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b19844-2678-490f-b191-e00426829b95 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.732306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d6b77-d3a8-4ec6-a89a-71fa686c408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.732306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d6b77-d3a8-4ec6-a89a-71fa686c408d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.732306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d6b77-d3a8-4ec6-a89a-71fa686c408d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.732557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d6b77-d3a8-4ec6-a89a-71fa686c408d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.745113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d6b77-d3a8-4ec6-a89a-71fa686c408d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5a3d6b77-d3a8-4ec6-a89a-71fa686c408d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:32.753272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:32.754857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 307/604] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:32.755693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d6b77-d3a8-4ec6-a89a-71fa686c408d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.855344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b19844-2678-490f-b191-e00426829b95 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.880226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d6b77-d3a8-4ec6-a89a-71fa686c408d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:32.901179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.901857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.902134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.902401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.903217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:32.903523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.904934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.918915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 298/605] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:32.919752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:32.928468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a8cd-75ef-4f05-bda5-e6626e024783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:32.929990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a8cd-75ef-4f05-bda5-e6626e024783 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:32.930281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a8cd-75ef-4f05-bda5-e6626e024783 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:32.930564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727a8cd-75ef-4f05-bda5-e6626e024783 None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/17335764c3fd4960ab969211ca353b75/roles/d1ec8d970c824de78ea63e57d8720241` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:32.948757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727a8cd-75ef-4f05-bda5-e6626e024783 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=17335764c3fd4960ab969211ca353b75, role_id=d1ec8d970c824de78ea63e57d8720241)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:32.950247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727a8cd-75ef-4f05-bda5-e6626e024783 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:32.957737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.035844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 308/606] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:25:32 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/17335764c3fd4960ab969211ca353b75/roles/d1ec8d970c824de78ea63e57d8720241 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:33.036623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0740a2-b62a-492c-921d-2aca9b54a3a3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.037055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a8cd-75ef-4f05-bda5-e6626e024783 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.051711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.099666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.101147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.101818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.102268 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.110965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.112818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:33.133767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:33.134771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:33.135669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:33.135669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:33.135669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:33.135669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:33.135669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:33.135669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:33.135669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:33.135669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:33.138451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 299/607] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:33.139649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.202214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727a8cd-75ef-4f05-bda5-e6626e024783 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.252663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.253349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.253625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.253896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.254685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:33.254986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.256391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.270167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 309/608] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:33.272499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.282625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.296723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea04044e-df75-4bfe-9d2d-f66517ec93d5 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.346184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38ea5d-546f-43fe-8090-bc8fc8f8472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.347770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ea5d-546f-43fe-8090-bc8fc8f8472f None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.348299 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ea5d-546f-43fe-8090-bc8fc8f8472f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.349019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38ea5d-546f-43fe-8090-bc8fc8f8472f None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/175b409f5ee842ddb9f5f3468a6a461b/roles/d1ec8d970c824de78ea63e57d8720241` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.365552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.371364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38ea5d-546f-43fe-8090-bc8fc8f8472f None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=175b409f5ee842ddb9f5f3468a6a461b, role_id=d1ec8d970c824de78ea63e57d8720241)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.373191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38ea5d-546f-43fe-8090-bc8fc8f8472f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.418483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fdc00-460f-425d-9b6a-bc094e602fb6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.453633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 300/609] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:25:33 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/175b409f5ee842ddb9f5f3468a6a461b/roles/d1ec8d970c824de78ea63e57d8720241 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:33.455009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38ea5d-546f-43fe-8090-bc8fc8f8472f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.486885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.487958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.488597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.489071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.491000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:33.491153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.494634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.520334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 310/610] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:33.529342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.598196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38ea5d-546f-43fe-8090-bc8fc8f8472f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.645598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.646420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.646726 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.646996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.659300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.661603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.664808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:33.687999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:33.689210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:33.690103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:33.690103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:33.690103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:33.690103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:33.690103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 301/611] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:33.699824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.763652 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49625eed-b8a2-4512-b53c-4c62a552d8fa None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.794219 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.812990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509d635-7d02-4968-b01b-9a050e59711b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.813904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d635-7d02-4968-b01b-9a050e59711b None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.814183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d635-7d02-4968-b01b-9a050e59711b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.814490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509d635-7d02-4968-b01b-9a050e59711b None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/ab54d18d265a42ce9e341e59c57d4625/roles/d1ec8d970c824de78ea63e57d8720241` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.836321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509d635-7d02-4968-b01b-9a050e59711b None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=ab54d18d265a42ce9e341e59c57d4625, role_id=d1ec8d970c824de78ea63e57d8720241)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.837800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509d635-7d02-4968-b01b-9a050e59711b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.860362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cea2d3-4195-4639-809f-4c809d137602 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:33.891448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60c9fd-10e5-4237-a683-0ba36ba95a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:33.893705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c9fd-10e5-4237-a683-0ba36ba95a91 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.893705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c9fd-10e5-4237-a683-0ba36ba95a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.893705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60c9fd-10e5-4237-a683-0ba36ba95a91 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.893705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60c9fd-10e5-4237-a683-0ba36ba95a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:33.893975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60c9fd-10e5-4237-a683-0ba36ba95a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:33.895596 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60c9fd-10e5-4237-a683-0ba36ba95a91 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:33.908904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 302/612] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:33.918488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf7498-b130-4540-aa16-52055780f004 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.918488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf7498-b130-4540-aa16-52055780f004 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.918488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf7498-b130-4540-aa16-52055780f004 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.918488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 303/613] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:33.919410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf7498-b130-4540-aa16-52055780f004 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:33.925385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 311/614] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:25:33 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/ab54d18d265a42ce9e341e59c57d4625/roles/d1ec8d970c824de78ea63e57d8720241 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:33.935415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4586-8b88-476a-94ff-9db91354ff64 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:33.935738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4586-8b88-476a-94ff-9db91354ff64 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:33.935984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeea4586-8b88-476a-94ff-9db91354ff64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:33.991017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:33.996025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-eeea4586-8b88-476a-94ff-9db91354ff64 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:33.997890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eeea4586-8b88-476a-94ff-9db91354ff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:34.100229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 312/615] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:34.111418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf7498-b130-4540-aa16-52055780f004 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.127640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea4586-8b88-476a-94ff-9db91354ff64 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.176728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.177559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.177837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.178204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.195889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.197372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:34.231211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:34.232252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:34.233193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 304/616] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:34.238538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.250269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeea4586-8b88-476a-94ff-9db91354ff64 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.253153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.303383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11966d6-9957-4894-970c-7c10e76a7304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.305328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11966d6-9957-4894-970c-7c10e76a7304 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.305717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11966d6-9957-4894-970c-7c10e76a7304 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.306185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11966d6-9957-4894-970c-7c10e76a7304 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.324251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11966d6-9957-4894-970c-7c10e76a7304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a11966d6-9957-4894-970c-7c10e76a7304 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:34.333816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:34.335252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:34.337021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:34.338819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 313/617] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:34.344650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11966d6-9957-4894-970c-7c10e76a7304 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.398024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17875864-d8f1-44e4-9709-e366a5c89e25 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.431672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.479923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.481084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.481566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.482081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.484822 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:34.485443 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.488358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.509382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11966d6-9957-4894-970c-7c10e76a7304 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.527388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 305/618] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:34.533779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.576132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.578134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.579694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.580767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.581765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:34.583885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.585666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.603916 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 314/619] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:34.611713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.683522 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:34.780397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947b41e-f72b-49f0-86a3-51a7ba5ee3ad None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.831228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.832036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.832312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.832580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.850080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf49428-cb5f-492a-9155-67da08f26895 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:34.856503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.857951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:34.895266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:34.896645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:34.897531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:34.897531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:34.897531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:34.897531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:34.897531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 306/620] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:34.903804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.905609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:34.906424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:34.906730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:34.907174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:34.919573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:34.921050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:34.940755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:34.942107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:34.943016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:34.943016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:34.943016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:34.943016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:34.943016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 315/621] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:34.951561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:34.952325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:35.042573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ebfc37-dbe5-42a3-8628-5423c8bda2d7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:35.082789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:35.083469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.083751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.084027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.084753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:35.085059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:35.086895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:35.101694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 307/622] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:35.110226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:35.158996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:35.196834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e331f7-b556-4dfa-964e-3a8a0d188266 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:35.270392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:35.271090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.271366 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.271638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.272365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:35.272665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:35.274126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:35.287073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:35.305740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 316/623] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:35.310079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:35.321072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac748bf-91b5-4c19-b339-c5c432113214 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:35.362231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:35.363067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.363345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.363637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.371830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:35.373291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:35.396506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:35.397597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:35.398587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 308/624] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:35.404065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:35.519603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f5e56-c4f6-4aad-8288-bea9d8cc8f21 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:35.558979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:35.559669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.559949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.560219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.561033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:35.561341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:35.562862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:35.573135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da314f92-ab48-4db7-ba36-457da52c6fc6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:35.577069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 309/625] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:35.582879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:35.585970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:35.684651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:35.685905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.686407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.686919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.708108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:35.711436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:35.714119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:35.728803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5ae121-838b-4e23-8f7a-550b43fead73 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:35.733358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:35.734593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:35.736189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:35.740961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 317/626] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:25:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:35.747333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:35.803706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd885e5b-34e8-4851-802e-7ffdd68fa207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:35.804560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885e5b-34e8-4851-802e-7ffdd68fa207 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.804840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885e5b-34e8-4851-802e-7ffdd68fa207 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.805107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd885e5b-34e8-4851-802e-7ffdd68fa207 None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/df88788d6691436c983cdb53f5e4c53e/roles/d1ec8d970c824de78ea63e57d8720241` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.837775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd885e5b-34e8-4851-802e-7ffdd68fa207 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=df88788d6691436c983cdb53f5e4c53e, role_id=d1ec8d970c824de78ea63e57d8720241)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:35.839372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd885e5b-34e8-4851-802e-7ffdd68fa207 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:35.908842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9009b7-9c81-4a71-8c11-c2fd1f703ff5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:35.919987 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 310/627] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:25:35 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/df88788d6691436c983cdb53f5e4c53e/roles/d1ec8d970c824de78ea63e57d8720241 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:25:35.946763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ce69-aa4a-45ff-aeca-39c38e590e39 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.947019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ce69-aa4a-45ff-aeca-39c38e590e39 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.947300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0ce69-aa4a-45ff-aeca-39c38e590e39 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.948870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 311/628] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:35.956153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cc10-0731-4fa4-aa49-c47ee7c28188 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.956541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cc10-0731-4fa4-aa49-c47ee7c28188 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.956832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe7cc10-0731-4fa4-aa49-c47ee7c28188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.974311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:35.976130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:35.976805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:35.977297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:35.978489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:35.979408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:35.981606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:35.983250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-bbe7cc10-0731-4fa4-aa49-c47ee7c28188 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:35.985286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bbe7cc10-0731-4fa4-aa49-c47ee7c28188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:36.008637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 318/629] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:25:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:36.015374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.050933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.080020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 312/630] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:36.113217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7cc10-0731-4fa4-aa49-c47ee7c28188 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.133933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.216498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25445598-327e-41e5-853a-976f7f74e61e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.268835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61591bc0-d869-4000-a694-68e67150b128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.270137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591bc0-d869-4000-a694-68e67150b128 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.270686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591bc0-d869-4000-a694-68e67150b128 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.271170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591bc0-d869-4000-a694-68e67150b128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.296668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe7cc10-0731-4fa4-aa49-c47ee7c28188 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.350163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e76229-21ab-4752-91c1-a999110b2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.352091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76229-21ab-4752-91c1-a999110b2dbb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.352850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76229-21ab-4752-91c1-a999110b2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.353374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e76229-21ab-4752-91c1-a999110b2dbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.374646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e76229-21ab-4752-91c1-a999110b2dbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:36.381928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61591bc0-d869-4000-a694-68e67150b128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-f5e76229-21ab-4752-91c1-a999110b2dbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:36.384233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:36.385983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:36.387698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:36.390595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61591bc0-d869-4000-a694-68e67150b128 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.390763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 313/631] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:36.394794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e76229-21ab-4752-91c1-a999110b2dbb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.467611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.470100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.525763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 319/632] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:36.527483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29198-80b0-4ec5-b8eb-82bda21fd381 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.527905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29198-80b0-4ec5-b8eb-82bda21fd381 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.528294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac29198-80b0-4ec5-b8eb-82bda21fd381 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.530200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 320/633] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:36.534922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29198-80b0-4ec5-b8eb-82bda21fd381 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.564049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e76229-21ab-4752-91c1-a999110b2dbb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.606278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1add07-4302-4125-8840-0347f5144422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.607370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1add07-4302-4125-8840-0347f5144422 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.607817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1add07-4302-4125-8840-0347f5144422 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.608258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1add07-4302-4125-8840-0347f5144422 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.609160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1add07-4302-4125-8840-0347f5144422 None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:36.609613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1add07-4302-4125-8840-0347f5144422 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.611900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1add07-4302-4125-8840-0347f5144422 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.623058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 314/634] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:36.624960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a60a1-4de7-4dc7-a016-66b323c716b3 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.625394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a60a1-4de7-4dc7-a016-66b323c716b3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.625816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a60a1-4de7-4dc7-a016-66b323c716b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.644946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-c94a60a1-4de7-4dc7-a016-66b323c716b3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:36.646573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c94a60a1-4de7-4dc7-a016-66b323c716b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:36.654306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac29198-80b0-4ec5-b8eb-82bda21fd381 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.700263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.701276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.701665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.702047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.716014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.717830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:36.742704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:36.743642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:36.744820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:36.744820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:36.744820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:36.744820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:36.744820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 321/636] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:36.744820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.745228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 315/636] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:36.753268 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a60a1-4de7-4dc7-a016-66b323c716b3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.758642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.792488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:36.873293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a60a1-4de7-4dc7-a016-66b323c716b3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.877821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e6331-b0a7-443d-a847-ccb89a7c7ea8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:36.913283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.914678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.914965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.915233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.915955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:36.916256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.917667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.921676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87039b84-46dc-4627-a21d-a97479121482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:36.922792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87039b84-46dc-4627-a21d-a97479121482 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.923260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87039b84-46dc-4627-a21d-a97479121482 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.923714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87039b84-46dc-4627-a21d-a97479121482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.931525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 316/637] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:36.932379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:36.939422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87039b84-46dc-4627-a21d-a97479121482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:36.941197 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87039b84-46dc-4627-a21d-a97479121482 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-87039b84-46dc-4627-a21d-a97479121482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:36.963693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:36.964683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:36.965601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:36.965601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:36.965601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:36.965601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:36.967548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 322/638] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:36.968960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131510-38a9-4fd7-af73-54f887dfd4e9 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:36.969537 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131510-38a9-4fd7-af73-54f887dfd4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:36.969816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66131510-38a9-4fd7-af73-54f887dfd4e9 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:36.971294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 323/639] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:36.971831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66131510-38a9-4fd7-af73-54f887dfd4e9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.049685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.056038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.067512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb07599-049b-43ab-b12a-2b09d4de13ab None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.095948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66131510-38a9-4fd7-af73-54f887dfd4e9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.124889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67efdf-83fd-4318-8a65-d9cf0665086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.126143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67efdf-83fd-4318-8a65-d9cf0665086b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.126633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67efdf-83fd-4318-8a65-d9cf0665086b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.127116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67efdf-83fd-4318-8a65-d9cf0665086b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.132248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83367-18e3-4ba5-905e-f7ef4382e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.133325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83367-18e3-4ba5-905e-f7ef4382e86c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.133607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83367-18e3-4ba5-905e-f7ef4382e86c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.133932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83367-18e3-4ba5-905e-f7ef4382e86c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.141193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba83367-18e3-4ba5-905e-f7ef4382e86c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.142664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba83367-18e3-4ba5-905e-f7ef4382e86c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.144465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67efdf-83fd-4318-8a65-d9cf0665086b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5ba83367-18e3-4ba5-905e-f7ef4382e86c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:37.157626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:37.158914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:37.159810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:37.159810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:37.159810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:37.159810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:37.159810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:37.159810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:37.159810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:37.159810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-8d67efdf-83fd-4318-8a65-d9cf0665086b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:37.160237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:37.161152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:37.168872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 317/640] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:37.169968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 324/641] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:37.170058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67efdf-83fd-4318-8a65-d9cf0665086b None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.170141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc233f-4549-4cd0-aeed-b4336482ecff None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.170141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc233f-4549-4cd0-aeed-b4336482ecff None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.170141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc233f-4549-4cd0-aeed-b4336482ecff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.185293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d5fc233f-4549-4cd0-aeed-b4336482ecff None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:37.186690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d5fc233f-4549-4cd0-aeed-b4336482ecff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:37.283349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 325/642] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:37.284436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc233f-4549-4cd0-aeed-b4336482ecff None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.310263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67efdf-83fd-4318-8a65-d9cf0665086b None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.365675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.367764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.369160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.369809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.370283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.371631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:37.372164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.374821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.392226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 318/643] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.393353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.422214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.445665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc233f-4549-4cd0-aeed-b4336482ecff None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.492867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.493571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.493843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.494116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.494970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:37.495274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.496701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.511056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 326/644] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.512267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.538014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8e9e8-007d-4fee-94db-3c38143aad72 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.586949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.587422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.587708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.587982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.588726 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:37.589030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.590459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.604206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 319/645] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.604206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.630765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdeede6-110e-4394-bf24-bc937be5c570 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.642159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.669732 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff11c2-ac2d-4608-a291-b72498495fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.670657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff11c2-ac2d-4608-a291-b72498495fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.670934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff11c2-ac2d-4608-a291-b72498495fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.671224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff11c2-ac2d-4608-a291-b72498495fd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.686456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff11c2-ac2d-4608-a291-b72498495fd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8fff11c2-ac2d-4608-a291-b72498495fd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:37.695071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:37.696225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 327/646] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:37.702205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff11c2-ac2d-4608-a291-b72498495fd2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.704074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.736313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f7d786-51c2-4c4b-85ec-c454920eef8e None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.774938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.778543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.778820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.780170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.789893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.791377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:37.808293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:37.809548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:37.810895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 320/647] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:37.815069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.821676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff11c2-ac2d-4608-a291-b72498495fd2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.863673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.864433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.864722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.865008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:37.865834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=5643e9f777c94d06a2f5c687dd8919b6) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:37.866147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:37.868524 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:37.886576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 328/648] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/role_assignments?user.id=5643e9f777c94d06a2f5c687dd8919b6&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:37.886576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:37.947601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59183e1-2d99-48db-b799-55b8e6c63feb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:37.948542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:37.993079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:37.994621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:37.994621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:37.994621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.004910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.015247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.018003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.045925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c57b9-4933-4575-a4a6-406901b06747 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:38.054903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:38.055895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:38.056799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:38.056799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:38.056799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:38.056799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:38.063193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 321/649] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:38.064843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.093898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.095332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.095844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.096327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.097307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:38.097853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.100044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.110702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 329/650] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:38.112140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.209810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec44c6-066b-4d13-8b63-4dd45fa4447a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.248391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.255248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044304a-800e-4fb8-8923-6358c040aa1a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.262988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.263766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.264050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.265664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.265664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:38.265664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.267040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.295497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 322/651] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:38.299381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.321346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.322027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.322306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.322604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.323385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:38.323660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.325825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.340671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 330/652] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:38.341623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.362186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.441705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a444de-7129-4203-9bf6-f2e9956d7348 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.478512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dd518-d944-411e-a65f-7d0029481660 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.496512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.497468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.497854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.498228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.510199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.512001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.525388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172c833-781f-4baa-acd3-36a7b4485ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.526298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c833-781f-4baa-acd3-36a7b4485ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.527364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c833-781f-4baa-acd3-36a7b4485ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.527797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172c833-781f-4baa-acd3-36a7b4485ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:38.533087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:38.534180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:38.535364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:38.535364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:38.535364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:38.535364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:38.541956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 323/653] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:38.541956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.570517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.635054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172c833-781f-4baa-acd3-36a7b4485ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.636878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172c833-781f-4baa-acd3-36a7b4485ce9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.670167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.674809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b10a13-5c88-42c0-96f7-2eff5f71e193 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.716384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.717195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.717472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.718170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.729447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.729447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:38.744708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:38.745742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 324/654] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:38.747145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.784721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 331/655] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:38.786635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf4059-0b10-45da-8945-64cd58f437d0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.786977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf4059-0b10-45da-8945-64cd58f437d0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.787253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf4059-0b10-45da-8945-64cd58f437d0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.790593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 332/656] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:38.790593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf4059-0b10-45da-8945-64cd58f437d0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.867177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.871823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e0f0e-e79b-4637-816b-e57aebc8c788 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.927168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf4059-0b10-45da-8945-64cd58f437d0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:38.930840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.931966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.932422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.932882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.934267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:38.934806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.937616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.963301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 325/657] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:38.963301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:38.970119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13be9d-8c29-49d4-8cee-81747b619a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:38.970930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13be9d-8c29-49d4-8cee-81747b619a21 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.971305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13be9d-8c29-49d4-8cee-81747b619a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.971657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13be9d-8c29-49d4-8cee-81747b619a21 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:38.972574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13be9d-8c29-49d4-8cee-81747b619a21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:38.972891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13be9d-8c29-49d4-8cee-81747b619a21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:38.974349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13be9d-8c29-49d4-8cee-81747b619a21 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:38.993112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:38.998324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 333/658] 10.222.0.60 () {56 vars in 1137 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:38.998324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7fcf0-13ee-47f1-b252-dbc1d344b60a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:38.998324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7fcf0-13ee-47f1-b252-dbc1d344b60a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:38.998324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7fcf0-13ee-47f1-b252-dbc1d344b60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.015469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-73e7fcf0-13ee-47f1-b252-dbc1d344b60a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:39.016676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-73e7fcf0-13ee-47f1-b252-dbc1d344b60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:39.134810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 334/659] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:39.134810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7fcf0-13ee-47f1-b252-dbc1d344b60a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:39.135572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c0a75-f3ff-41d3-bae7-a71710b484c3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:39.172857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:39.173667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:39.173945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:39.174222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.186385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:39.188119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:39.195160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:39.208180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:39.219976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:39.221104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:39.221104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:39.221104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:39.221104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:39.221104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 326/660] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:39.221104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:39.284014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7fcf0-13ee-47f1-b252-dbc1d344b60a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:39.303452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:39.330723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:39.331531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:39.331888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:39.332175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.340650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:39.342352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:39.343444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68396fd-9d44-467a-9670-65ae6c03a940 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:39.359188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:39.360225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:39.361183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 335/661] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:39.361853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:39.393864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9dd1b-0c78-48b7-a723-3d2c94921f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:39.394825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9dd1b-0c78-48b7-a723-3d2c94921f3e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:39.395110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9dd1b-0c78-48b7-a723-3d2c94921f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:39.395387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9dd1b-0c78-48b7-a723-3d2c94921f3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.500965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9dd1b-0c78-48b7-a723-3d2c94921f3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:39.502432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9dd1b-0c78-48b7-a723-3d2c94921f3e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:39.510678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe08f0-aa1b-458b-b19c-a363a3d62650 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:39.514021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:39.558156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eb0ea-478e-4b06-86d7-d831912c82ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:39.559258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eb0ea-478e-4b06-86d7-d831912c82ed None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:39.559452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eb0ea-478e-4b06-86d7-d831912c82ed None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:39.559635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6eb0ea-478e-4b06-86d7-d831912c82ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.572279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6eb0ea-478e-4b06-86d7-d831912c82ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1a6eb0ea-478e-4b06-86d7-d831912c82ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:39.582162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:39.583311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:39.584148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 336/662] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:39.586157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eb0ea-478e-4b06-86d7-d831912c82ed None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:39.598139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:39.640582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 327/663] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:39.642324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9dd1b-0c78-48b7-a723-3d2c94921f3e None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:39.708153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6eb0ea-478e-4b06-86d7-d831912c82ed None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:39.766498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:39.767592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:39.768038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:39.768334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.769340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:39.769651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:39.773016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:39.790981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9dd1b-0c78-48b7-a723-3d2c94921f3e None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:39.792618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 337/664] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:39.799749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:39.843669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:39.844391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:39.845122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:39.845391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:39.845653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:39.846484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:39.846819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:39.848250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:39.869514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 328/665] 10.222.0.60 () {56 vars in 1139 bytes} [Thu May 26 12:25:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:39.870815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:39.907019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:39.953017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7518da6-9a91-4964-8105-1936749b4d22 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.008681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.009724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.010076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.010547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.011804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:40.012166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.014339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.023129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1eaf4d-9fb7-4c5c-938e-8b5b5b844737 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.033121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 338/666] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:40.033121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.064564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.065501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.065785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.066058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.079311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.081001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:40.101751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:40.102984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:40.104294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:40.104294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:40.104294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:40.104294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:40.109035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 329/667] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:40.110498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.149941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.167388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362ec94-56d6-4312-9c09-cb553b64c927 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.211322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.212202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.212483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.212760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.221822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.222640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.223672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:40.242121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:40.243316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 339/668] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:40.249556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.257100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25266e68-3741-4458-b910-5298eaff97ea None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.318346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fb1e5-f14d-4f3d-9cc7-d6bc56bf732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.319133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb1e5-f14d-4f3d-9cc7-d6bc56bf732a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.319829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb1e5-f14d-4f3d-9cc7-d6bc56bf732a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.320182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fb1e5-f14d-4f3d-9cc7-d6bc56bf732a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.380255 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31c22a-71a3-4c71-a9f0-81462a2a973f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.423437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fb1e5-f14d-4f3d-9cc7-d6bc56bf732a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.423966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.425149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.425689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.426212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.426351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fb1e5-f14d-4f3d-9cc7-d6bc56bf732a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.439823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.441316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.448726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:40.460054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:40.465945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:40.467051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:40.467051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:40.467051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:40.467051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:40.467051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 340/669] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:40.467051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.523989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.545399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 330/670] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:40.546457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fb1e5-f14d-4f3d-9cc7-d6bc56bf732a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.581152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd41ec5-2103-4511-b023-db5bf4315763 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.624533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ea3fe-2753-4f40-b33c-d019b3aef286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.625204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ea3fe-2753-4f40-b33c-d019b3aef286 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.625482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ea3fe-2753-4f40-b33c-d019b3aef286 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.625763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ea3fe-2753-4f40-b33c-d019b3aef286 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.626492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ea3fe-2753-4f40-b33c-d019b3aef286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:40.626826 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ea3fe-2753-4f40-b33c-d019b3aef286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.628196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ea3fe-2753-4f40-b33c-d019b3aef286 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.641118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 341/671] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:40.642357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cade03-ab9b-4fca-a54a-39361a7f46dc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.642674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cade03-ab9b-4fca-a54a-39361a7f46dc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.642979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cade03-ab9b-4fca-a54a-39361a7f46dc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.646582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 342/672] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:40.646582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cade03-ab9b-4fca-a54a-39361a7f46dc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.682873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fb1e5-f14d-4f3d-9cc7-d6bc56bf732a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.718102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.718799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.719080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.719348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.720129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:40.720440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.721857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.724919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.733674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 331/673] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:40.734505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.780242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:40.796709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cade03-ab9b-4fca-a54a-39361a7f46dc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:40.862724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:40.863737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:40.864158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:40.864573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:40.865759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:40.866236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:40.868597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:40.893576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 343/674] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:40.895153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:40.968007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a7546-5a31-410c-8013-a0d304df951c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.004879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d7b64-f117-428f-b9db-908a27d088cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.005780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d7b64-f117-428f-b9db-908a27d088cf None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.006058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d7b64-f117-428f-b9db-908a27d088cf None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.006355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d7b64-f117-428f-b9db-908a27d088cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.009673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690511bf-faba-40e8-bef6-16862173ef70 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.017705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d7b64-f117-428f-b9db-908a27d088cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.019435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d7b64-f117-428f-b9db-908a27d088cf None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.027586 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-ff2d7b64-f117-428f-b9db-908a27d088cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:41.036911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:41.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:41.048542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:41.048542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:41.048542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:41.048542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:41.048542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 332/675] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:41.048542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8071-4541-4af7-b23b-5faf85092368 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.048542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8071-4541-4af7-b23b-5faf85092368 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.048542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bb8071-4541-4af7-b23b-5faf85092368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.048982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.048982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.048982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.048982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.053005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.057185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.058192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-78bb8071-4541-4af7-b23b-5faf85092368 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:41.059460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-78bb8071-4541-4af7-b23b-5faf85092368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:41.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:41.072271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 344/676] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:41.073532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.133401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 333/677] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:41.134257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb8071-4541-4af7-b23b-5faf85092368 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.164249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.196437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed514-2852-4168-bd91-5db1667b13c5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.240309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.241149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.241894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.242167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.243038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=17335764c3fd4960ab969211ca353b75) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.243345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.244777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.251654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 345/678] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/role_assignments?user.id=17335764c3fd4960ab969211ca353b75&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.252514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.261972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bb8071-4541-4af7-b23b-5faf85092368 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.309295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.310222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.310497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.310796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.320394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.321371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.323625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:41.341251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:41.342586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:41.343764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:41.348093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 334/679] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:41.349051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.391815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535e4b6-1da3-4e0e-b6e2-6d396069498b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.430962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.431752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.432174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.432545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.433444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.433862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.435380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.448347 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.450682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 346/680] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.451606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.475317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9c598d-8c65-45a0-a852-aa2eeff794fe None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.521809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.522548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.523529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.524015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.524863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.525177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.526647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.545075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 335/681] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.545075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.578292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a1041-c3a1-48e1-a149-a98d8a119177 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.580087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.616701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10740f6-0fe1-494a-8dd5-d4d253146962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.617917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10740f6-0fe1-494a-8dd5-d4d253146962 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.618376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10740f6-0fe1-494a-8dd5-d4d253146962 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.619186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10740f6-0fe1-494a-8dd5-d4d253146962 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.638079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10740f6-0fe1-494a-8dd5-d4d253146962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d10740f6-0fe1-494a-8dd5-d4d253146962 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:41.646141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:41.647400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:41.648413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:41.650840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 347/682] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:41.652369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10740f6-0fe1-494a-8dd5-d4d253146962 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.671406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd823807-256e-471b-95dd-93c88c4b1295 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.711461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.712024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.712295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.712568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.713403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.713703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.715259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.732419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.742018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 336/683] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.742018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.773488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10740f6-0fe1-494a-8dd5-d4d253146962 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.818444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.819425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.820556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.820980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.828218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.829778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:41.846568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:41.847725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:41.848812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:41.848812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:41.848812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:41.848812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:41.848812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:41.848812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:41.848812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:41.848812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:41.854621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 348/684] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:41.854621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.870405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1288b0a-8fce-4518-94b5-32fc52584d99 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:41.880213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:41.918408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:41.918886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:41.919287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:41.922339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:41.922339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=175b409f5ee842ddb9f5f3468a6a461b) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:41.922339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:41.922756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:41.938721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 337/685] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/role_assignments?user.id=175b409f5ee842ddb9f5f3468a6a461b&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:41.938721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:41.985949 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7e9d3-fd7a-4695-95e2-ec2e0b90ba02 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.038240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.039261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.039261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.039445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.040156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:42.040461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.041882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.053701 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.059219 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 349/686] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:42.060842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.115535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd58a25-664e-4205-acd9-4e632012aa1d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.166970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e71f0-56d2-40c7-8ff9-88567f1fb559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.167880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e71f0-56d2-40c7-8ff9-88567f1fb559 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.168346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e71f0-56d2-40c7-8ff9-88567f1fb559 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.168810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e71f0-56d2-40c7-8ff9-88567f1fb559 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.173965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.205196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5de8ea-202f-4c05-8a45-d2b8f5f7e62a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.265579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.266304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.266608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.267037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.268181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:42.268659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.270332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.283175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e71f0-56d2-40c7-8ff9-88567f1fb559 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.284631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e71f0-56d2-40c7-8ff9-88567f1fb559 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.287113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 350/687] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:42.288463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.375757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.426967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 338/688] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:42.428137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e71f0-56d2-40c7-8ff9-88567f1fb559 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.445380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bff29c-c8e0-488d-8777-6f9046d2ed48 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.486666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.487483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.487762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.488129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.502590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.504237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.509654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:42.528762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:42.529874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:42.531005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:42.531005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:42.531005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:42.531005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:42.532959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 351/689] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:42.533994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.545392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e71f0-56d2-40c7-8ff9-88567f1fb559 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.588665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.589725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.590183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.590707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.592594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=ab54d18d265a42ce9e341e59c57d4625) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:42.592904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.595720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.614777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 339/690] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/role_assignments?user.id=ab54d18d265a42ce9e341e59c57d4625&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:42.616192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.667391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.708386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521425bc-48c1-459a-95fd-358c93d92204 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.758163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.759017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.759303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.760214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.774990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.776609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:42.800205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:42.801572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:42.802740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:42.802740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:42.802740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:42.802740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:42.803408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 352/691] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:42.811660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:42.858269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e652befc-7482-4357-ac26-b99a4482510d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:42.915019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:42.918435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:42.920567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:42.921171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:42.922053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:42.924307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:42.925022 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:42.927235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:42.950775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 340/692] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:42.958288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:43.095018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:43.126558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d26b95-2cae-40ea-9d60-71f513c917b8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:43.177399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e01cf-0ba1-4c0c-a841-b51e8482caba None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:43.201623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:43.202432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.202760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.203033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.215182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:43.216637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:43.253979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:43.255023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:43.255945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:43.258452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:43.259190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.259623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.259908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.260658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:43.260966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:43.262361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:43.266457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 341/693] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:43.273146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:43.293583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 353/694] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:43.302042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:43.478387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71d979-8440-40c8-9d5c-82ac118d5cab None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:43.508878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695756c-608d-42ef-a055-a0ec472b2f14 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:43.526029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:43.557367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:43.558061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.558341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.558717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.559568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:43.559882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:43.563985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:43.595122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:43.598015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.598499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.599014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.628606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:43.630077 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:43.630297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 342/695] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:25:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:43.635842 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:43.654883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:43.665793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:43.672292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:43.673414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 354/696] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:43.677310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:43.816667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e58b06-0e99-4ff2-9544-45cc15af09de None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:43.853289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254b060-1c5a-4d27-9e24-1b9c40947893 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:43.870956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124c0fd-7538-492a-b7b6-eb35e9cb2720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:43.872075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124c0fd-7538-492a-b7b6-eb35e9cb2720 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.872616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124c0fd-7538-492a-b7b6-eb35e9cb2720 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.873094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6124c0fd-7538-492a-b7b6-eb35e9cb2720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.912877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b582f-afd8-4dc0-8d5d-6f8c75c52795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:43.915496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b582f-afd8-4dc0-8d5d-6f8c75c52795 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.915496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b582f-afd8-4dc0-8d5d-6f8c75c52795 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.915496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b582f-afd8-4dc0-8d5d-6f8c75c52795 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.915978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b582f-afd8-4dc0-8d5d-6f8c75c52795 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:43.916285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b582f-afd8-4dc0-8d5d-6f8c75c52795 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:43.917735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b582f-afd8-4dc0-8d5d-6f8c75c52795 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:43.932807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 355/697] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:43.934361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe4440-5c09-4786-945c-18923b34db0b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:43.934724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe4440-5c09-4786-945c-18923b34db0b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:43.935009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe4440-5c09-4786-945c-18923b34db0b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:43.942557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 356/698] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:43.942557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe4440-5c09-4786-945c-18923b34db0b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:43.968892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:43.980397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124c0fd-7538-492a-b7b6-eb35e9cb2720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:43.983404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6124c0fd-7538-492a-b7b6-eb35e9cb2720 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:43.998661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.054690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe4440-5c09-4786-945c-18923b34db0b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.096664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8becf-e670-4990-92d1-123f708c0e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.097789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8becf-e670-4990-92d1-123f708c0e36 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.098393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8becf-e670-4990-92d1-123f708c0e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.098866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8becf-e670-4990-92d1-123f708c0e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.099977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8becf-e670-4990-92d1-123f708c0e36 None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=df88788d6691436c983cdb53f5e4c53e) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:44.100362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8becf-e670-4990-92d1-123f708c0e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.102367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d8becf-e670-4990-92d1-123f708c0e36 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.111804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 357/699] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:43 2022] GET /identity/v3/role_assignments?user.id=df88788d6691436c983cdb53f5e4c53e&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:44.113102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab580a-8775-4015-8374-119865d02c30 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.113459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab580a-8775-4015-8374-119865d02c30 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.114073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab580a-8775-4015-8374-119865d02c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.136640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-69ab580a-8775-4015-8374-119865d02c30 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:44.137967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-69ab580a-8775-4015-8374-119865d02c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:44.145029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 343/700] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:44.153588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124c0fd-7538-492a-b7b6-eb35e9cb2720 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.228549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 358/701] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:44.274464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab580a-8775-4015-8374-119865d02c30 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.304212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.352500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6124c0fd-7538-492a-b7b6-eb35e9cb2720 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.368919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.423878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.424692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.424973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.425241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.436439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.437872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.445937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab580a-8775-4015-8374-119865d02c30 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:44.459517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:44.460729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:44.461772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:44.461772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:44.461772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:44.461772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:44.461772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 344/702] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:44.467688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.486066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.486925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.487203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.487478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.488328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.490219 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:44.506621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:44.508779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:44.510484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 359/703] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:44.521508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.592685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a5cf8-b4e3-480d-b208-d9b17743bc42 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.646130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.647578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.648473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.648473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.649033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:44.649667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.651248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.672767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.675002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 345/704] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:44.681118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.696017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf6de-3a0e-4483-b899-7b4a564f5c61 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.714579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:44.745103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.746701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.747198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.747616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.748909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:44.749365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.751624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.758240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 360/705] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:44.763563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.832145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb130b-8815-43b7-b40f-b8c13cafa5bc None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.879358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165a065-ccb3-496a-ad9f-cb0b9f197b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.880171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a065-ccb3-496a-ad9f-cb0b9f197b1f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.880452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a065-ccb3-496a-ad9f-cb0b9f197b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.880724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165a065-ccb3-496a-ad9f-cb0b9f197b1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.893152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165a065-ccb3-496a-ad9f-cb0b9f197b1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.894907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165a065-ccb3-496a-ad9f-cb0b9f197b1f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-9165a065-ccb3-496a-ad9f-cb0b9f197b1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:44.916086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:44.917007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:44.917908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 346/706] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:44.922561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fc10-61e6-4876-b561-ee5c41aed94f None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.922561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fc10-61e6-4876-b561-ee5c41aed94f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.922561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6fc10-61e6-4876-b561-ee5c41aed94f None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.922561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 347/707] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:44.925051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fc10-61e6-4876-b561-ee5c41aed94f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:44.939681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd6ad9-2d99-4c2c-87bb-19e62e6f9c22 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:44.978735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb4976-a509-4b70-8409-eda6be8c052d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:44.979887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb4976-a509-4b70-8409-eda6be8c052d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.980271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb4976-a509-4b70-8409-eda6be8c052d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.980656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb4976-a509-4b70-8409-eda6be8c052d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:44.981640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb4976-a509-4b70-8409-eda6be8c052d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:44.982102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb4976-a509-4b70-8409-eda6be8c052d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:44.983950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb4976-a509-4b70-8409-eda6be8c052d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:44.994827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 361/708] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:44.996720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d95004-031e-42c7-958b-d771a6d123f3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:44.997112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d95004-031e-42c7-958b-d771a6d123f3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:44.997481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d95004-031e-42c7-958b-d771a6d123f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.026586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.037656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b4d95004-031e-42c7-958b-d771a6d123f3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:45.039258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b4d95004-031e-42c7-958b-d771a6d123f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:45.048264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6fc10-61e6-4876-b561-ee5c41aed94f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.059746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.090405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.091125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.091411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.091693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.092507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:45.092823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.094319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.108439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 348/709] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:45.119647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.169000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 362/710] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:45.220302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d95004-031e-42c7-958b-d771a6d123f3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.266329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23266d-04f8-4f28-8d26-925e7ea548c7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.310944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ad42-5e68-439e-9f08-88f42033116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.311850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ad42-5e68-439e-9f08-88f42033116e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.312134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ad42-5e68-439e-9f08-88f42033116e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.312455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ad42-5e68-439e-9f08-88f42033116e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.313343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9ad42-5e68-439e-9f08-88f42033116e None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=5643e9f777c94d06a2f5c687dd8919b6) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:45.313656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9ad42-5e68-439e-9f08-88f42033116e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.315158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f9ad42-5e68-439e-9f08-88f42033116e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.323674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 349/711] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/role_assignments?user.id=5643e9f777c94d06a2f5c687dd8919b6&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=07de3e1931ca4d799df8510428e181aa => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:45.426465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d95004-031e-42c7-958b-d771a6d123f3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.480559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.481763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.482283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.482801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.490323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e5d5-29d9-42f6-b5dd-eb18408fc19e None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.490681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e5d5-29d9-42f6-b5dd-eb18408fc19e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.490906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb08e5d5-29d9-42f6-b5dd-eb18408fc19e None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.493269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 350/712] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:25:45.500471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83d74a-7c84-419e-8e3e-04a0e2f9b5a6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.501245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83d74a-7c84-419e-8e3e-04a0e2f9b5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.502902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83d74a-7c84-419e-8e3e-04a0e2f9b5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.505980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.508724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.510661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.519150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:45.532922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:45.534075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:45.535004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:45.535004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:45.535004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:45.535004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:45.538682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 363/713] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:45.542304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.542487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ad83d74a-7c84-419e-8e3e-04a0e2f9b5a6 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:45.543546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ad83d74a-7c84-419e-8e3e-04a0e2f9b5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:45.624154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 351/714] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:45.665877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83d74a-7c84-419e-8e3e-04a0e2f9b5a6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.712660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5ed1-f494-42b3-a6e4-d9e8d1faa103 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.783514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83d74a-7c84-419e-8e3e-04a0e2f9b5a6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:45.794561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.795240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.795521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.795796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.796527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:45.796831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.798200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.822392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 364/715] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:45.827506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.851022 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:45.855734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:45.856539 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:45.856816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:45.857087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:45.857745 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:45.859186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:45.880869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:45.882482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:45.883483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:45.885995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 352/716] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:45.891955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:45.973912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.058814 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68319c82-7d92-413c-9633-41dcb3a1d8a8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.062276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6ee7b-1fab-4dbd-b4d0-63d61d5ef81c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.140909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c48cd8-96e6-412c-98ab-2362358568f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.141806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c48cd8-96e6-412c-98ab-2362358568f9 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.142721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c48cd8-96e6-412c-98ab-2362358568f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.144035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c48cd8-96e6-412c-98ab-2362358568f9 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.144783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c48cd8-96e6-412c-98ab-2362358568f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.146255 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c48cd8-96e6-412c-98ab-2362358568f9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.159325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.160015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.160294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.160567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.161335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] RBAC: Adding query filter params (name=network) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:46.161642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.163667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.172874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 353/717] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:25:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:46.179325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:46.254591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:46.287181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 365/718] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:25:45 2022] POST /identity/v3/users => generated 254 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:46.315789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9540a9-b33f-4135-b683-50e41f7e9a9c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:46.361116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f35140-85ba-49e9-af64-393e7cd0dc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:46.362061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35140-85ba-49e9-af64-393e7cd0dc2f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:46.362499 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35140-85ba-49e9-af64-393e7cd0dc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:46.363097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f35140-85ba-49e9-af64-393e7cd0dc2f None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:46.363969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f35140-85ba-49e9-af64-393e7cd0dc2f None admin] RBAC: Adding query filter params (type=network) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:46.364420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f35140-85ba-49e9-af64-393e7cd0dc2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:46.365919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f35140-85ba-49e9-af64-393e7cd0dc2f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:46.374684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 354/719] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:25:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:47.265951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0834-7408-4e1a-b065-a6bbb0537e8e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.266491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0834-7408-4e1a-b065-a6bbb0537e8e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.266491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d0834-7408-4e1a-b065-a6bbb0537e8e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.268155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 366/720] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:47.280772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda51c80-9f22-476d-870e-15a18a940ca3 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.281082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda51c80-9f22-476d-870e-15a18a940ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.281339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda51c80-9f22-476d-870e-15a18a940ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.309430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-dda51c80-9f22-476d-870e-15a18a940ca3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:47.310667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-dda51c80-9f22-476d-870e-15a18a940ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:47.416288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 355/721] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:47.461580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0834-7408-4e1a-b065-a6bbb0537e8e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:47.617789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d0834-7408-4e1a-b065-a6bbb0537e8e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.635879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:47.667693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9c5da-82ae-4d37-8f9f-872a7a0b70e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.668595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c5da-82ae-4d37-8f9f-872a7a0b70e9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.668881 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c5da-82ae-4d37-8f9f-872a7a0b70e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.669205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9c5da-82ae-4d37-8f9f-872a7a0b70e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.691509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9c5da-82ae-4d37-8f9f-872a7a0b70e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-85b9c5da-82ae-4d37-8f9f-872a7a0b70e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:47.701047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:47.702220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:47.703225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 367/722] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:47.710972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda51c80-9f22-476d-870e-15a18a940ca3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:47.838207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:47.904430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda51c80-9f22-476d-870e-15a18a940ca3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:47.970508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410bea1-00e7-4555-890e-9ddb0b0a6b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:47.971235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bea1-00e7-4555-890e-9ddb0b0a6b58 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:47.971529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bea1-00e7-4555-890e-9ddb0b0a6b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:47.971775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410bea1-00e7-4555-890e-9ddb0b0a6b58 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:47.972542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410bea1-00e7-4555-890e-9ddb0b0a6b58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:47.972837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410bea1-00e7-4555-890e-9ddb0b0a6b58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:47.974232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d410bea1-00e7-4555-890e-9ddb0b0a6b58 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:47.984660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 356/723] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:47.991109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9c5da-82ae-4d37-8f9f-872a7a0b70e9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.099013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78ec8-a4ea-4b8f-b083-e8709c43df5d None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.099345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78ec8-a4ea-4b8f-b083-e8709c43df5d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.099561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78ec8-a4ea-4b8f-b083-e8709c43df5d None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.102169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 357/724] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:48.107500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d07ba-e6db-416b-bb04-7f11c8ee4b50 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.107766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d07ba-e6db-416b-bb04-7f11c8ee4b50 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.108001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d07ba-e6db-416b-bb04-7f11c8ee4b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.142278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-914d07ba-e6db-416b-bb04-7f11c8ee4b50 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:48.150553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-914d07ba-e6db-416b-bb04-7f11c8ee4b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:48.158226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9c5da-82ae-4d37-8f9f-872a7a0b70e9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.212117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9d244-71bd-4716-8c7b-e698c61072d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.212945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9d244-71bd-4716-8c7b-e698c61072d7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.213227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9d244-71bd-4716-8c7b-e698c61072d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.213489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9d244-71bd-4716-8c7b-e698c61072d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.235669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9d244-71bd-4716-8c7b-e698c61072d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:48.237498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9d244-71bd-4716-8c7b-e698c61072d7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:48.253721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 358/725] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 12:25:48.255247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabb8d-f04c-4a31-b488-f5853f15481c None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.255532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabb8d-f04c-4a31-b488-f5853f15481c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.255805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fabb8d-f04c-4a31-b488-f5853f15481c None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-faf9d244-71bd-4716-8c7b-e698c61072d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:48.261126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:48.262009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:48.262945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:48.262945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:48.262945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:48.262945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:48.265196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 368/727] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:48.270004 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 359/727] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:48.271406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fabb8d-f04c-4a31-b488-f5853f15481c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.272538 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab7b3c-75c5-4514-84ed-0d597b6d316c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.273597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab7b3c-75c5-4514-84ed-0d597b6d316c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.274084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab7b3c-75c5-4514-84ed-0d597b6d316c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.296572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d2ab7b3c-75c5-4514-84ed-0d597b6d316c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:48.298111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d2ab7b3c-75c5-4514-84ed-0d597b6d316c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:48.333363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.357781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.404434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 369/728] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:48.406196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab7b3c-75c5-4514-84ed-0d597b6d316c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.449969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fabb8d-f04c-4a31-b488-f5853f15481c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.490641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.491889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.492368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.492838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.493820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:48.494269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:48.495930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:48.514369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 360/729] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:48.515752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.523845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab7b3c-75c5-4514-84ed-0d597b6d316c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.562596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8486-2de5-4d26-ae32-16f5eb06d1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.563635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8486-2de5-4d26-ae32-16f5eb06d1b4 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.564177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8486-2de5-4d26-ae32-16f5eb06d1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.564684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7b8486-2de5-4d26-ae32-16f5eb06d1b4 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.565620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8486-2de5-4d26-ae32-16f5eb06d1b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:48.567227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7b8486-2de5-4d26-ae32-16f5eb06d1b4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:48.633918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06315f-3e77-4461-8735-d20ca520e4ea None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.642108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.674223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4fd9c-3f05-4760-baf0-262f2a4892e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.675056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4fd9c-3f05-4760-baf0-262f2a4892e6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.675342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4fd9c-3f05-4760-baf0-262f2a4892e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.675612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4fd9c-3f05-4760-baf0-262f2a4892e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.688127 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4fd9c-3f05-4760-baf0-262f2a4892e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:48.696817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 370/730] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:25:48 2022] POST /identity/v3/services => generated 251 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-89e4fd9c-3f05-4760-baf0-262f2a4892e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:48.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:48.704017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:48.704898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:48.705614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8486-2de5-4d26-ae32-16f5eb06d1b4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.705693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 361/731] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:48.707064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4fd9c-3f05-4760-baf0-262f2a4892e6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.720350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:48.856752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7b8486-2de5-4d26-ae32-16f5eb06d1b4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.905803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.906861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.907845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.908227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.919051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:48.921218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:48.927572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4fd9c-3f05-4760-baf0-262f2a4892e6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:48.941504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:48.942578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:48.943528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:48.950757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 371/732] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:48.957984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:48.996318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:48.997017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:48.997297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:48.997570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:48.998351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:48.998689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.000102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.020470 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 362/733] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:49.028706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.086215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.108331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.149633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fe261-c4f0-495e-8066-f627a5b59759 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.192926 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.193718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.194098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.194462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.195491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:49.195806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.197483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.199848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f197a-c841-4b4e-9ea7-20bffcdfde04 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.219874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 372/734] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 26 12:25:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:49.229783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.242508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237898e-5271-4583-87ab-c853b8076a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.242974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237898e-5271-4583-87ab-c853b8076a31 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.243252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237898e-5271-4583-87ab-c853b8076a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.243520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237898e-5271-4583-87ab-c853b8076a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.255581 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237898e-5271-4583-87ab-c853b8076a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.257214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237898e-5271-4583-87ab-c853b8076a31 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-8237898e-5271-4583-87ab-c853b8076a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:49.283230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:49.284138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:49.285084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:49.285084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:49.285084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:49.285084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:49.285084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 363/735] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:49.286129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207521-fef0-42b2-8b27-fad2be76dcd2 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.286404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207521-fef0-42b2-8b27-fad2be76dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.286704 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8207521-fef0-42b2-8b27-fad2be76dcd2 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.288920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 364/736] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:49.295651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207521-fef0-42b2-8b27-fad2be76dcd2 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.405728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cbe63-5437-4e7f-a057-c49faadfd109 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.419209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.438698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.444100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8207521-fef0-42b2-8b27-fad2be76dcd2 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.450278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8401940-9d5f-4377-a80f-77d5f8dac9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.451473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401940-9d5f-4377-a80f-77d5f8dac9d0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.451969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401940-9d5f-4377-a80f-77d5f8dac9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.452483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8401940-9d5f-4377-a80f-77d5f8dac9d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.496272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db550d3f-2e78-4b47-b373-5a0cebb7fff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.497056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550d3f-2e78-4b47-b373-5a0cebb7fff9 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.497631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550d3f-2e78-4b47-b373-5a0cebb7fff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.497908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db550d3f-2e78-4b47-b373-5a0cebb7fff9 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.499033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550d3f-2e78-4b47-b373-5a0cebb7fff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:49.499421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550d3f-2e78-4b47-b373-5a0cebb7fff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.501094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db550d3f-2e78-4b47-b373-5a0cebb7fff9 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.521877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 365/737] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:49.524503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78da31-9870-488d-81d6-71a927d911cc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.525025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78da31-9870-488d-81d6-71a927d911cc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.525452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78da31-9870-488d-81d6-71a927d911cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.550504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-db78da31-9870-488d-81d6-71a927d911cc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:49.551911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-db78da31-9870-488d-81d6-71a927d911cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:49.573227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8401940-9d5f-4377-a80f-77d5f8dac9d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.575530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8401940-9d5f-4377-a80f-77d5f8dac9d0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.653411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 366/738] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 12:25:49.654352 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78da31-9870-488d-81d6-71a927d911cc None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.723675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 373/739] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 12:25:49.725191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8401940-9d5f-4377-a80f-77d5f8dac9d0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.767410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.768431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:49.815763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78da31-9870-488d-81d6-71a927d911cc None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.856327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea87938-6ae1-4d7f-95f0-cb745023f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.857174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea87938-6ae1-4d7f-95f0-cb745023f8af None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.857455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea87938-6ae1-4d7f-95f0-cb745023f8af None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.857730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea87938-6ae1-4d7f-95f0-cb745023f8af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.859942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8401940-9d5f-4377-a80f-77d5f8dac9d0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:49.870266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea87938-6ae1-4d7f-95f0-cb745023f8af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.872984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea87938-6ae1-4d7f-95f0-cb745023f8af None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-eea87938-6ae1-4d7f-95f0-cb745023f8af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:49.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:49.891698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:49.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 367/740] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:49.894550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f3b6b-2617-4c49-815b-3a8ad25d3514 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.894550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f3b6b-2617-4c49-815b-3a8ad25d3514 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.894550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f3b6b-2617-4c49-815b-3a8ad25d3514 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.896497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 368/741] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:49.899737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f3b6b-2617-4c49-815b-3a8ad25d3514 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:49.915852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0aaa8-4a48-45a5-be19-ac57ba76d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:49.916548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aaa8-4a48-45a5-be19-ac57ba76d604 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:49.916831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aaa8-4a48-45a5-be19-ac57ba76d604 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:49.917103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0aaa8-4a48-45a5-be19-ac57ba76d604 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:49.917839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0aaa8-4a48-45a5-be19-ac57ba76d604 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:49.919548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0aaa8-4a48-45a5-be19-ac57ba76d604 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:50.020108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 374/742] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:25:49 2022] POST /identity/v3/services => generated 240 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:50.021272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0aaa8-4a48-45a5-be19-ac57ba76d604 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:50.067055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f3b6b-2617-4c49-815b-3a8ad25d3514 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.116257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:50.130437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc0b526-34b7-4c8c-96f2-d0e96b78fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:50.132290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b526-34b7-4c8c-96f2-d0e96b78fa3f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.132764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b526-34b7-4c8c-96f2-d0e96b78fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.133218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc0b526-34b7-4c8c-96f2-d0e96b78fa3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.148840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0b526-34b7-4c8c-96f2-d0e96b78fa3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:50.150839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc0b526-34b7-4c8c-96f2-d0e96b78fa3f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:50.164091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-6fc0b526-34b7-4c8c-96f2-d0e96b78fa3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:50.174381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:50.175628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:50.176608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:50.176608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:50.176608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:50.176608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:50.183623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 369/743] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:50.185205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0aaa8-4a48-45a5-be19-ac57ba76d604 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.187062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a332b5-51fd-41a3-bf0d-5ccaa6e2afd9 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.187777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a332b5-51fd-41a3-bf0d-5ccaa6e2afd9 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.188281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a332b5-51fd-41a3-bf0d-5ccaa6e2afd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.208549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b8a332b5-51fd-41a3-bf0d-5ccaa6e2afd9 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:50.211977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b8a332b5-51fd-41a3-bf0d-5ccaa6e2afd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:50.232006 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:50.232813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.233559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.234581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.235209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:50.235517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:50.237205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:50.258842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 375/744] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:25:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:50.259947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:50.325523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 370/745] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:50.327248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a332b5-51fd-41a3-bf0d-5ccaa6e2afd9 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:50.446202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2aab1-f1b6-4b77-be13-368290b4dcd5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.471988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a332b5-51fd-41a3-bf0d-5ccaa6e2afd9 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.496149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:50.497133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.497619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.498053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.499257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:50.499763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:50.502230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:50.520852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 376/746] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:50.522250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:50.533303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:50.534134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.534556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.534945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.550505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:50.553239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:50.556334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:50.580154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:50.581967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:50.583077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:50.583077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:50.583077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:50.583077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:50.585173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 371/747] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:50.586334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:50.710561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa53bb-b329-49a1-af63-aa2b183d14cb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.751296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4958863-afd0-4b0d-9244-1dda03c72deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:50.752546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958863-afd0-4b0d-9244-1dda03c72deb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.753194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958863-afd0-4b0d-9244-1dda03c72deb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.753750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4958863-afd0-4b0d-9244-1dda03c72deb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.756000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:50.756245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1c689-4b92-48e9-833c-eb669df8f56f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.769573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4958863-afd0-4b0d-9244-1dda03c72deb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a4958863-afd0-4b0d-9244-1dda03c72deb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:50.779700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:50.781570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:50.782459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:50.792186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 377/748] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:50.793365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4958863-afd0-4b0d-9244-1dda03c72deb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:50.799173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:50.800249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.800603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.800953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.809919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:50.811519 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:50.826686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:50.828258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:50.829188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 372/749] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:50.829705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:50.859572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:50.898247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:50.944324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4958863-afd0-4b0d-9244-1dda03c72deb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.948315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96046607-0912-424b-89d6-63ae8da1cda0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:50.986994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:50.987795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:50.988145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:50.988493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:50.989443 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:50.989831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:50.991866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:50.999363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.000373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.000859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.005650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.005822 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 373/750] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:51.005822 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.007246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:51.007774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.009372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.025337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 378/751] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:51.026666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.097291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:51.117792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f36d70-d55a-4847-a9ad-c72d33598f82 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.142557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c91dea-42db-4d05-b087-ce47c7a1b1e4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.158645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.159458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.159813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.160206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.161253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:51.161373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.163547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.175517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:51.177226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 374/752] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:51.178198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.186683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.194811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.194811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.194811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.200662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.202821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:51.223269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:51.224249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:51.225138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:51.225138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:51.225138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:51.225138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:51.234731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 379/753] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:51.234731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.323461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b853b62-3214-445e-b603-8a74faa19482 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.376619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.378371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.378843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.379553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.384387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5d65f-51de-465f-a2b5-6457eba4ee5e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.391872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.393448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:51.409662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:51.410671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:51.411571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 375/754] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:51.412064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.414694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:51.438664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.439760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.440245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.440688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.441626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=df88788d6691436c983cdb53f5e4c53e) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:51.441939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.443459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.450611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 380/755] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:51 2022] GET /identity/v3/role_assignments?user.id=df88788d6691436c983cdb53f5e4c53e&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=07de3e1931ca4d799df8510428e181aa => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:51.451340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.506694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:51.602841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc4dff-982a-4ce1-8442-e2f7cb4b3ee8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.621245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107570-30a6-4747-a7f1-3a5989cf994c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.683810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.683810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.683810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.684305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.685787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:51.686237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.687925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.711050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.712263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.712771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.713247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.714295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:51.714866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.716643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.733938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 376/756] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:51.743007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.752616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 381/757] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:51.758607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:51.864551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:51.894388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6a912-e3fe-4553-9d3c-775392121644 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.896047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:51.909859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ac227-1b1d-45ad-a090-1c4489f62c05 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:51.950295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b24082-971c-4599-ae83-12710ddbbbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.951436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b24082-971c-4599-ae83-12710ddbbbd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.951722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b24082-971c-4599-ae83-12710ddbbbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.952004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b24082-971c-4599-ae83-12710ddbbbd8 None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/5643e9f777c94d06a2f5c687dd8919b6/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.954341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b24082-971c-4599-ae83-12710ddbbbd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=5643e9f777c94d06a2f5c687dd8919b6, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.954836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7938ba-1736-483e-a7a7-f696ebcbc7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:51.955725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7938ba-1736-483e-a7a7-f696ebcbc7eb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.955847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b24082-971c-4599-ae83-12710ddbbbd8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.956066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7938ba-1736-483e-a7a7-f696ebcbc7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.956410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7938ba-1736-483e-a7a7-f696ebcbc7eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.964706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7938ba-1736-483e-a7a7-f696ebcbc7eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:51.966296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7938ba-1736-483e-a7a7-f696ebcbc7eb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-3d7938ba-1736-483e-a7a7-f696ebcbc7eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:51.983526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:51.984712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:51.985838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:51.986434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 377/758] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:25:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:51.987700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd451a62-21e6-4e49-ba77-ba1d6b311af0 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.989628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd451a62-21e6-4e49-ba77-ba1d6b311af0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.989628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd451a62-21e6-4e49-ba77-ba1d6b311af0 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:51.989628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 378/759] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:51.995993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d857a6-8334-4744-a2d7-3791c8c9c51d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:51.996275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d857a6-8334-4744-a2d7-3791c8c9c51d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:51.996550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d857a6-8334-4744-a2d7-3791c8c9c51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.016470 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f5d857a6-8334-4744-a2d7-3791c8c9c51d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:52.018228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f5d857a6-8334-4744-a2d7-3791c8c9c51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:52.056343 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 382/760] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:25:51 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/5643e9f777c94d06a2f5c687dd8919b6/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:52.058131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b24082-971c-4599-ae83-12710ddbbbd8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.166949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 379/761] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:52.189543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d857a6-8334-4744-a2d7-3791c8c9c51d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.268447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.334367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d857a6-8334-4744-a2d7-3791c8c9c51d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.369007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b24082-971c-4599-ae83-12710ddbbbd8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.373527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.374812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.375307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.375876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.376758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.378659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:52.395472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:52.396502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:52.397397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:52.400272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 380/762] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:52.408558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.436407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.437961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.438454 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.439027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.440743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:52.441291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.445093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.468959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 383/763] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:52.474921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.536952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed60c2c-c34f-47ec-8470-c523ce24716c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.546777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.580465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.643320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.644434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.644710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.645168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.646136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:52.646449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.648052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.665056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b539b-bfab-4e62-b1e3-9fd8e4f39a63 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.666751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 381/764] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:52.671975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.729557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ce67b-3269-4fd8-9b7e-0281c8c74d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.730239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce67b-3269-4fd8-9b7e-0281c8c74d1b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.730545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce67b-3269-4fd8-9b7e-0281c8c74d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.730841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ce67b-3269-4fd8-9b7e-0281c8c74d1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.812028 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce67b-3269-4fd8-9b7e-0281c8c74d1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.813405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ce67b-3269-4fd8-9b7e-0281c8c74d1b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.817351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cca2cd-2742-40f2-af11-b74e043dc91f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:52.837940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.862990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88239715-8fff-4439-b028-77651ce6fdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:52.864212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239715-8fff-4439-b028-77651ce6fdef None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.864663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239715-8fff-4439-b028-77651ce6fdef None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.865026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88239715-8fff-4439-b028-77651ce6fdef None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.867809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88239715-8fff-4439-b028-77651ce6fdef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:52.868160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88239715-8fff-4439-b028-77651ce6fdef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:52.870782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88239715-8fff-4439-b028-77651ce6fdef None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:52.876750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 382/765] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:52.878066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6d41-2724-4529-8b5a-c60a6ddb6527 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.878347 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6d41-2724-4529-8b5a-c60a6ddb6527 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.878647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c6d41-2724-4529-8b5a-c60a6ddb6527 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:52.880190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 383/766] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:52.887909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6d41-2724-4529-8b5a-c60a6ddb6527 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:52.952329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:52.986682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 384/767] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:52.988996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a4a2-4fd7-4da4-bc49-1d4f0555f73a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:52.989285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a4a2-4fd7-4da4-bc49-1d4f0555f73a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:52.989563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4a4a2-4fd7-4da4-bc49-1d4f0555f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.011169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f6e4a4a2-4fd7-4da4-bc49-1d4f0555f73a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:53.013257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f6e4a4a2-4fd7-4da4-bc49-1d4f0555f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:53.019048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89c6d41-2724-4529-8b5a-c60a6ddb6527 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.065436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.066553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.066863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.067151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.068276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] RBAC: Adding query filter params (interface=public, service_id=477443448c714149bdc95b94d343e158, region_id=RegionOne) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:53.068587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.073886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.085941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 384/768] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 26 12:25:52 2022] GET /identity/v3/endpoints?service_id=477443448c714149bdc95b94d343e158&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:53.086876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.138633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 385/769] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:53.139555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4a4a2-4fd7-4da4-bc49-1d4f0555f73a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.227624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:53.246785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28813e3b-ea37-4c7e-93f0-45e0854c16dc None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.262289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:53.298613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.299722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.300010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.300289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.311519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4a4a2-4fd7-4da4-bc49-1d4f0555f73a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.316761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.318256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:53.342746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:53.344700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:53.346626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:53.346626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:53.346626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:53.346626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:53.347104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 385/770] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:53.347716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.373788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9da7e-c28c-4b4c-b384-5f627c4a532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.374477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9da7e-c28c-4b4c-b384-5f627c4a532b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.374880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9da7e-c28c-4b4c-b384-5f627c4a532b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.375156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9da7e-c28c-4b4c-b384-5f627c4a532b None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.375854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9da7e-c28c-4b4c-b384-5f627c4a532b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.377316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9da7e-c28c-4b4c-b384-5f627c4a532b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.384374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 386/771] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/services => generated 772 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:53.385344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9da7e-c28c-4b4c-b384-5f627c4a532b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.499365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf7fdfb-cf8c-4403-8ed7-dedc2246ceef None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.520590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9da7e-c28c-4b4c-b384-5f627c4a532b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.538922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:53.555990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.557205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.557693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.558168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] PATH_INFO: `/v3/services/network` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.559119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.560957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.564171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.565292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.565619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.565898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.570095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:53.570095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.570095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.590596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 387/772] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:53.590596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:53.592154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:53.593559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:53.594667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:53.597736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 386/773] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:53.605195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.665769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:53.759742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5d2cd-4501-4cc1-849d-00af970885a2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.804103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8ee4-a000-4983-8f55-0967cdda237a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:53.805961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.807008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.807350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.807670 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.816954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.818439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:53.837886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:53.840946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:53.842717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 388/774] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:53.845059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.877169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:53.877890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:53.878216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:53.878492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:53.879278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] RBAC: Adding query filter params (name=network) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:53.879623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:53.882221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:53.888445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 387/775] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:53.900781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:53.917201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:53.998868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d054c9-d9cb-455b-8c6c-b532a401838d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.053595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.054692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.055126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.055576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.056536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:54.058293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.060000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.083913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 389/776] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:54.091711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.153895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:54.182175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5be9e3-c64e-41b4-9c6a-d6662052f0fd None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.237149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86887a76-1d5f-4789-becb-b3d10716eb8b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.240069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:54.288740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.289433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.289711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.289984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.290866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=709a912079c747838254b83f06568cca) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:54.291181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.294546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.299307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f329491-d64d-4e67-a1aa-9c320baa3bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.299989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329491-d64d-4e67-a1aa-9c320baa3bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.300268 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329491-d64d-4e67-a1aa-9c320baa3bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.300539 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329491-d64d-4e67-a1aa-9c320baa3bd1 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.301254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329491-d64d-4e67-a1aa-9c320baa3bd1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:54.301606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329491-d64d-4e67-a1aa-9c320baa3bd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.303968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f329491-d64d-4e67-a1aa-9c320baa3bd1 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.311053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 390/777] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/role_assignments?user.id=709a912079c747838254b83f06568cca&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:54.317379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 388/778] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:25:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:54.324272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.339435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5ebf-42c6-4b68-8ab9-c2708997bbe6 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.339852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5ebf-42c6-4b68-8ab9-c2708997bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.340109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd5ebf-42c6-4b68-8ab9-c2708997bbe6 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.341901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 389/779] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:54.348506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122a9a-7e65-4548-b19b-0049d4e10060 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.348863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122a9a-7e65-4548-b19b-0049d4e10060 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.349056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92122a9a-7e65-4548-b19b-0049d4e10060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.386599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-92122a9a-7e65-4548-b19b-0049d4e10060 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:54.387847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-92122a9a-7e65-4548-b19b-0049d4e10060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:54.503896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 390/780] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:25:54.531597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92122a9a-7e65-4548-b19b-0049d4e10060 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.587932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b376a-88ac-4374-9440-096c24fccc3b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.658693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.659411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.659611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:54.659716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.659969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.660814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] RBAC: Adding query filter params (interface=public, service_id=1df9f95ab00e4e1ba0f6371a15568a49, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:54.661136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.662773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.666790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92122a9a-7e65-4548-b19b-0049d4e10060 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.685046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 391/781] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/endpoints?service_id=1df9f95ab00e4e1ba0f6371a15568a49&interface=public®ion_id=RegionOne => generated 194 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:54.690783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.722299 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ebea7-3e71-4171-898e-77cf84f8fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.724508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ebea7-3e71-4171-898e-77cf84f8fd6a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.726800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ebea7-3e71-4171-898e-77cf84f8fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.727104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ebea7-3e71-4171-898e-77cf84f8fd6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.749226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:54.763576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271ebea7-3e71-4171-898e-77cf84f8fd6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-271ebea7-3e71-4171-898e-77cf84f8fd6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:54.782061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:54.783084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:54.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 391/782] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:54.792077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ebea7-3e71-4171-898e-77cf84f8fd6a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:54.857188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6041b9-8d8d-468b-adaa-1a45d7839411 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:54.909968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8334e77b-7619-4134-bc93-a3e7a3240ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:54.911534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e77b-7619-4134-bc93-a3e7a3240ccc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.911837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e77b-7619-4134-bc93-a3e7a3240ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.912116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8334e77b-7619-4134-bc93-a3e7a3240ccc None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.913315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334e77b-7619-4134-bc93-a3e7a3240ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:54.914753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8334e77b-7619-4134-bc93-a3e7a3240ccc None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:54.922319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 392/783] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:54.924391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a0a8-2aee-4100-92f4-ec146d54fed4 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.925050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a0a8-2aee-4100-92f4-ec146d54fed4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.925335 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a0a8-2aee-4100-92f4-ec146d54fed4 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.927294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 393/784] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:54.936476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c13f9-61dc-4565-94f2-12b8b128a4f7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:54.936782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c13f9-61dc-4565-94f2-12b8b128a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:54.937125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c13f9-61dc-4565-94f2-12b8b128a4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:54.975730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5a9c13f9-61dc-4565-94f2-12b8b128a4f7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:54.977009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5a9c13f9-61dc-4565-94f2-12b8b128a4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:55.031279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ebea7-3e71-4171-898e-77cf84f8fd6a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.070573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.071260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.071536 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.071806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.072562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:55.072862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:55.074252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:55.086847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 392/785] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:55.092954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.106892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.137120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 394/786] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:55.173419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c13f9-61dc-4565-94f2-12b8b128a4f7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.198310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.250111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a351bc-d96b-4b83-bce6-f9df99dd0b19 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.307537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.308946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.309231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.309502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.315729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c13f9-61dc-4565-94f2-12b8b128a4f7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.324595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:55.325561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:55.348669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:55.349640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:55.351464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:55.351464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:55.351464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:55.351464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:55.351464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 393/787] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:55.357308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.371289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e3d3-342f-4121-8754-abc0346cefa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.372423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e3d3-342f-4121-8754-abc0346cefa7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.372706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e3d3-342f-4121-8754-abc0346cefa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.372979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5e3d3-342f-4121-8754-abc0346cefa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.394601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed5e3d3-342f-4121-8754-abc0346cefa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bed5e3d3-342f-4121-8754-abc0346cefa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:55.409355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:55.411796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:55.414625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 395/788] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:55.422610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e3d3-342f-4121-8754-abc0346cefa7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.425333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.517171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c9483-5dcd-4cc5-b67c-30e352b31271 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.594755 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.596189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.596728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.597217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.598159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:55.598703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:55.601076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:55.617397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.625900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 394/789] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:55.632796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.668929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed5e3d3-342f-4121-8754-abc0346cefa7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.734220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.734848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.735134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.735410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.736170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:55.736477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:55.737865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:55.749100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 396/790] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:55.756781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:55.846819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32a555-767b-4066-be60-3ad3c2a5bccf None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.866757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:55.904494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:55.907000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:55.907286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:55.907564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:55.920354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:55.921803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:55.955669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a86bf-014a-491c-90e8-9cb7916daf4d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:55.957777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:55.958764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:55.960654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 395/791] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:55.965672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.024715 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.025495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.025752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.026021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.039535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:56.052589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.055043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:56.086352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:56.087362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:56.088345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:56.088345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:56.088345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:56.088345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:56.088579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22b554-e249-4727-bd36-d265080ddb88 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.091911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 397/792] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:25:56.103980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.130632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.131385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.131855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.132198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.133152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:56.133464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.134958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.154937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 396/793] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 26 12:25:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:56.161088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.239037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:56.284387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d62e-9ec3-4a6c-8408-b16e75425445 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.324533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.325643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.326109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.326643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.327723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:56.328210 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.330280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.345446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 398/794] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:56.352954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.428861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea01043-15f5-4f25-b5f4-2adbcf67b964 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.451589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:56.485525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da5c0d-797e-4f8d-a833-d7a6dd909731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.486884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5c0d-797e-4f8d-a833-d7a6dd909731 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.487333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5c0d-797e-4f8d-a833-d7a6dd909731 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.487883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da5c0d-797e-4f8d-a833-d7a6dd909731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.502991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da5c0d-797e-4f8d-a833-d7a6dd909731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.505366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da5c0d-797e-4f8d-a833-d7a6dd909731 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.509418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d3da3-4b85-4a2e-a115-160d9dae9280 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-68da5c0d-797e-4f8d-a833-d7a6dd909731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:56.528986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:56.530118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:56.531283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:56.531283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:56.531283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:56.531283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:56.533229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 397/795] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:56.534769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1334ab-ca06-4dbd-b672-3293dc635349 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.535269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1334ab-ca06-4dbd-b672-3293dc635349 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.535751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1334ab-ca06-4dbd-b672-3293dc635349 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.537487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 398/796] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:56.539278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1334ab-ca06-4dbd-b672-3293dc635349 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.566696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d246c73-aa5d-4975-a4a8-b14b5a84a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.568047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246c73-aa5d-4975-a4a8-b14b5a84a790 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.568497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246c73-aa5d-4975-a4a8-b14b5a84a790 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.569137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d246c73-aa5d-4975-a4a8-b14b5a84a790 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.580581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d246c73-aa5d-4975-a4a8-b14b5a84a790 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.582321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d246c73-aa5d-4975-a4a8-b14b5a84a790 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2d246c73-aa5d-4975-a4a8-b14b5a84a790 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:56.603891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:56.605248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:25:56.606426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:56.608354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 399/797] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:56.614602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f5dc2-187b-4ce0-81bc-d58a1c04cb47 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.614602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f5dc2-187b-4ce0-81bc-d58a1c04cb47 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.614602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f5dc2-187b-4ce0-81bc-d58a1c04cb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.644315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-108f5dc2-187b-4ce0-81bc-d58a1c04cb47 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:56.646314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-108f5dc2-187b-4ce0-81bc-d58a1c04cb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:56.685242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:56.704163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1334ab-ca06-4dbd-b672-3293dc635349 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.754557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 400/798] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:56.754557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f5dc2-187b-4ce0-81bc-d58a1c04cb47 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.754926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.754926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.754926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.754926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.755439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:56.755439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:56.756313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:56.794579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 399/799] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:25:56.795439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:56.826605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:56.927047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f5dc2-187b-4ce0-81bc-d58a1c04cb47 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.957307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d779030-c094-47b3-9c74-8f1ce734a3cf None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:56.994326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:56.995399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:56.996102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:56.996530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:56.998264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:56.998752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.000466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.002932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.004518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.004518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.004789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.005617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.007812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:57.022943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:57.024215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 12:25:57.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:57.032116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 400/800] 10.222.0.60 () {56 vars in 1129 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:57.032116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.034948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 401/801] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:25:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:57.036026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.048925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.160633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c57fa4-c420-4b7b-8b76-94ef262a16cd None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.180226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.182963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2224bc-1401-4926-85bb-7c3ce050c925 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.202968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04e8f-c052-44e3-bd81-58f5b6d45595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.203902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04e8f-c052-44e3-bd81-58f5b6d45595 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.204085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04e8f-c052-44e3-bd81-58f5b6d45595 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.204751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04e8f-c052-44e3-bd81-58f5b6d45595 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.213239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04e8f-c052-44e3-bd81-58f5b6d45595 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.215029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04e8f-c052-44e3-bd81-58f5b6d45595 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.219651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.220559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.221017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.221470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.222365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:57.222874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.224404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.230245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 402/802] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 26 12:25:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-97f04e8f-c052-44e3-bd81-58f5b6d45595 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:57.231068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:57.231977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:57.232874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 401/803] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:57.234014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484b68-a4dc-4c4c-bed2-aef3010e6ad3 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.234283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.234381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484b68-a4dc-4c4c-bed2-aef3010e6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.234582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e484b68-a4dc-4c4c-bed2-aef3010e6ad3 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.239750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 402/804] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:57.239750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e484b68-a4dc-4c4c-bed2-aef3010e6ad3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.335716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.390469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62520ec-80a1-4f16-aadc-062f03adeb2e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.400663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e484b68-a4dc-4c4c-bed2-aef3010e6ad3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.431049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839f6cd-7978-4d13-97b5-e13255975487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.431719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f6cd-7978-4d13-97b5-e13255975487 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.432005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f6cd-7978-4d13-97b5-e13255975487 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.432281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839f6cd-7978-4d13-97b5-e13255975487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.455293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583af9e2-c330-4dbe-b2cf-283829b316aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.456283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583af9e2-c330-4dbe-b2cf-283829b316aa None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.456722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583af9e2-c330-4dbe-b2cf-283829b316aa None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.457129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583af9e2-c330-4dbe-b2cf-283829b316aa None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.458370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583af9e2-c330-4dbe-b2cf-283829b316aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:57.458879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583af9e2-c330-4dbe-b2cf-283829b316aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.461395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583af9e2-c330-4dbe-b2cf-283829b316aa None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.465957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.481560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 403/805] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:57.483627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9766d-30f1-4a8c-9831-b0088c3fad45 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.484046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9766d-30f1-4a8c-9831-b0088c3fad45 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.484397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9766d-30f1-4a8c-9831-b0088c3fad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.503675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-46e9766d-30f1-4a8c-9831-b0088c3fad45 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:57.504932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-46e9766d-30f1-4a8c-9831-b0088c3fad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:57.516211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839f6cd-7978-4d13-97b5-e13255975487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.517707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839f6cd-7978-4d13-97b5-e13255975487 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.590636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 404/806] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:57.590636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9766d-30f1-4a8c-9831-b0088c3fad45 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.647671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 403/807] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:25:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:25:57.658135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839f6cd-7978-4d13-97b5-e13255975487 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.665459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.719151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9766d-30f1-4a8c-9831-b0088c3fad45 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.740475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.759238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.759925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.760194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.760457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.761165 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:57.761463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.762865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.768072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 405/808] 10.222.0.60 () {56 vars in 1124 bytes} [Thu May 26 12:25:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:57.769119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.788190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839f6cd-7978-4d13-97b5-e13255975487 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.826148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b42da-c578-4566-a972-dc6955d0bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.827647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b42da-c578-4566-a972-dc6955d0bbf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.828111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b42da-c578-4566-a972-dc6955d0bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.828575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66b42da-c578-4566-a972-dc6955d0bbf4 None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/df88788d6691436c983cdb53f5e4c53e/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.832162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b42da-c578-4566-a972-dc6955d0bbf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=df88788d6691436c983cdb53f5e4c53e, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:57.834808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66b42da-c578-4566-a972-dc6955d0bbf4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:57.886551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436452e-2a9a-44f7-b684-d3ae8780543a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:57.918161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:57.929567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd6195-ad4c-4dc2-88e0-3bc5e6b49fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:57.930372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6195-ad4c-4dc2-88e0-3bc5e6b49fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.930689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6195-ad4c-4dc2-88e0-3bc5e6b49fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.930969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd6195-ad4c-4dc2-88e0-3bc5e6b49fc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.936619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 404/809] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:25:57 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/df88788d6691436c983cdb53f5e4c53e/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:25:57.937780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b42da-c578-4566-a972-dc6955d0bbf4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:57.943112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd6195-ad4c-4dc2-88e0-3bc5e6b49fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-44cd6195-ad4c-4dc2-88e0-3bc5e6b49fc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:25:57.951627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:57.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:57.953646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 406/810] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:25:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:57.954749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057ed5a-cc9f-424e-a92b-b6e20e124fe3 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:57.954749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057ed5a-cc9f-424e-a92b-b6e20e124fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:57.954890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057ed5a-cc9f-424e-a92b-b6e20e124fe3 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:57.961013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 407/811] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:25:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:25:57.961013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057ed5a-cc9f-424e-a92b-b6e20e124fe3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.080530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66b42da-c578-4566-a972-dc6955d0bbf4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.099850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057ed5a-cc9f-424e-a92b-b6e20e124fe3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.108778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:58.123149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.123959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.124246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.124523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.141093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.142749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.153210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e494a0-8b10-43b0-b942-9f628acb54b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.153931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e494a0-8b10-43b0-b942-9f628acb54b6 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.154216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e494a0-8b10-43b0-b942-9f628acb54b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.170203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e494a0-8b10-43b0-b942-9f628acb54b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.170203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e494a0-8b10-43b0-b942-9f628acb54b6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.170203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e494a0-8b10-43b0-b942-9f628acb54b6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:58.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:58.171436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:58.173965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:58.173965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:58.173965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:58.173965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:58.173965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 405/812] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:58.173965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.281403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad1a14-1d68-4bfb-8a2d-16d872061790 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.320996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24841b4-a39a-4960-a157-fd13c359f7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.323229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24841b4-a39a-4960-a157-fd13c359f7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.323229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24841b4-a39a-4960-a157-fd13c359f7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.323229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24841b4-a39a-4960-a157-fd13c359f7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.323229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24841b4-a39a-4960-a157-fd13c359f7b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:58.323524 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24841b4-a39a-4960-a157-fd13c359f7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.324669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24841b4-a39a-4960-a157-fd13c359f7b6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.340511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 406/813] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:25:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:58.340511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd252-5e33-430d-a071-93af652fa4f1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.340511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd252-5e33-430d-a071-93af652fa4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.340511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429bd252-5e33-430d-a071-93af652fa4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.362987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-429bd252-5e33-430d-a071-93af652fa4f1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:25:58.364693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-429bd252-5e33-430d-a071-93af652fa4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:25:58.365330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 408/814] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:25:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:58.366653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e494a0-8b10-43b0-b942-9f628acb54b6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.414140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:58.433931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:58.486900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 407/815] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:25:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:25:58.489659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd252-5e33-430d-a071-93af652fa4f1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.545931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e494a0-8b10-43b0-b942-9f628acb54b6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.591000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.591699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.592014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.592976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.593723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:58.594036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.596314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.617493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 409/816] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:58.618515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.650863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429bd252-5e33-430d-a071-93af652fa4f1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.699529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.700879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.701246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.701731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.723443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.725613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:25:58.746810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:58.747935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:58.748863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:25:58.748863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:25:58.748863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:25:58.748863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:58.750971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 408/817] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:58.753030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.767723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:58.773311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba303c-50b4-4ffd-b6e5-1578aac34123 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.779746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:58.820981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.822387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.823063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.823513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] PATH_INFO: `/v3/services/network` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.824387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.827120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:58.844341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:58.845578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 12:25:58.846733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:25:58.850381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 410/818] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:58 2022] GET /identity/v3/services/network => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:58.851378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.888480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33e9d97-b30c-4ede-94da-cb7c3e4807d3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:58.928393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:58.929551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:58.929906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:58.930277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:58.938163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:58.939771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:25:58.955791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:58.956760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:58.957773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:25:58.957773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:25:58.957773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:25:58.957773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:25:58.957773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:25:58.957773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:25:58.957773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:25:58.957773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:58.962463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 409/819] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:25:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:58.963490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:58.987420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dc9554-d515-45bd-938a-00a74ac0b29f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.039973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.041339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.042238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.042834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.043867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:59.044482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.046791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.066874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 411/820] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:59.067155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:59.068344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.098819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e32f5-30b8-4b6e-ad1f-c783afaf93af None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.107956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:59.140639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.141305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.141589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.141865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.142643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] RBAC: Adding query filter params (name=network) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:59.142976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.144642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.156233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 410/821] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:25:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:59.157166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.225093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e975af36-94f3-47c3-8b35-df019a504190 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.269262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.270341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.270808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb082c51-80d7-4d21-b35e-2da888405a94 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.271072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.271555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.273292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:59.273810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.281047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.294978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 412/822] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:59.296256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.316525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.317404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.317693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.318039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.327456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.329145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:25:59.348309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:25:59.349965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:25:59.352179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:59.354895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 411/823] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:25:59.355834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.416508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:59.433948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41c436-51e0-4d48-bffb-5f8627b4d332 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.471957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef9a5a-a179-40f6-9f01-2380658f7790 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.479398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.480419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.480898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.481382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.482498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] RBAC: Adding query filter params (type=network) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:59.483035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.484870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.493752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 413/824] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:59.495543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.516924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.517658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.517944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.518222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.519537 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=5643e9f777c94d06a2f5c687dd8919b6) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:59.519811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.521607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.529129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 412/825] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/role_assignments?user.id=5643e9f777c94d06a2f5c687dd8919b6&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=07de3e1931ca4d799df8510428e181aa => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:59.536544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.622778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c2fa4-d1a7-4bcf-aae5-f7a6bb6722aa None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.662326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.664435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.664918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.665471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.666561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:25:59.667083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.668833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.680144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:59.690946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 414/826] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:25:59.698255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:25:59.718949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:25:59.740456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec46d189-e092-4778-aaa2-cde7b19dab81 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.788158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca6c6-05ab-43fe-82d6-fd848d05851a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.789373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca6c6-05ab-43fe-82d6-fd848d05851a None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.789870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca6c6-05ab-43fe-82d6-fd848d05851a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.790364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dca6c6-05ab-43fe-82d6-fd848d05851a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.791571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dca6c6-05ab-43fe-82d6-fd848d05851a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.793389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dca6c6-05ab-43fe-82d6-fd848d05851a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:25:59.879810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 413/827] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:25:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:25:59.912922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6842e09-b718-4d54-9285-370829e97108 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:25:59.969921 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:25:59.971204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:25:59.971702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:25:59.972168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:25:59.985383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:25:59.987271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:00.008970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:00.010339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:00.011276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:00.011276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:00.011276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:00.011276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:00.013908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 415/828] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:00.021114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca6c6-05ab-43fe-82d6-fd848d05851a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.154031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dca6c6-05ab-43fe-82d6-fd848d05851a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.177678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:00.197667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.198364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.198703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.198990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.199731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:00.200040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:00.201439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.220465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 414/829] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:00.221855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.299128 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:00.353720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a75ed31-90b5-49a0-97c1-253970b9a2d4 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.391732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87499a4b-5dd9-4164-bace-2d445a32a516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.392543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499a4b-5dd9-4164-bace-2d445a32a516 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.392821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499a4b-5dd9-4164-bace-2d445a32a516 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.393090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87499a4b-5dd9-4164-bace-2d445a32a516 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.401249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87499a4b-5dd9-4164-bace-2d445a32a516 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:00.402791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87499a4b-5dd9-4164-bace-2d445a32a516 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-87499a4b-5dd9-4164-bace-2d445a32a516 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:00.419311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:00.420370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:00.421482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 416/830] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:00.428188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.440454 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981c608-d864-428d-a1c2-e6a2bedc2494 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.440768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981c608-d864-428d-a1c2-e6a2bedc2494 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.441535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981c608-d864-428d-a1c2-e6a2bedc2494 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.442722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 417/831] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:00.449288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf310-1597-4ca3-8831-e60df452d408 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.449581 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf310-1597-4ca3-8831-e60df452d408 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.449890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eaf310-1597-4ca3-8831-e60df452d408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.475732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-c7eaf310-1597-4ca3-8831-e60df452d408 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:00.477439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c7eaf310-1597-4ca3-8831-e60df452d408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:00.576057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 418/832] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:00.589414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060e44c-2f8a-4725-b279-5e98af4a4539 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.605388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaf310-1597-4ca3-8831-e60df452d408 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.637078 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.638261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.638824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.639297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.640317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:00.640927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:00.642840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.658190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 415/833] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:00.664530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.666768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:00.711861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:00.739195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eaf310-1597-4ca3-8831-e60df452d408 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.780677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b168-22a8-44f2-b837-fd73fadcb926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.781820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b168-22a8-44f2-b837-fd73fadcb926 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.782297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b168-22a8-44f2-b837-fd73fadcb926 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.782821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158b168-22a8-44f2-b837-fd73fadcb926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.786464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c087b9-4866-4794-b19a-8598bf146cbb None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.796237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158b168-22a8-44f2-b837-fd73fadcb926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b158b168-22a8-44f2-b837-fd73fadcb926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:00.804743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:00.805731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:00.806617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:00.809479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 419/834] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:26:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:00.815818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b168-22a8-44f2-b837-fd73fadcb926 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:00.835649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899120e-ab81-4af3-8ec6-e74652a82d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:00.836671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899120e-ab81-4af3-8ec6-e74652a82d34 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:00.836885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899120e-ab81-4af3-8ec6-e74652a82d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:00.837151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899120e-ab81-4af3-8ec6-e74652a82d34 None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/709a912079c747838254b83f06568cca/roles/d1ec8d970c824de78ea63e57d8720241` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:00.856861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899120e-ab81-4af3-8ec6-e74652a82d34 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=709a912079c747838254b83f06568cca, role_id=d1ec8d970c824de78ea63e57d8720241)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:00.858450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899120e-ab81-4af3-8ec6-e74652a82d34 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:00.946611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 416/835] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:26:00 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/709a912079c747838254b83f06568cca/roles/d1ec8d970c824de78ea63e57d8720241 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:26:00.954384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158b168-22a8-44f2-b837-fd73fadcb926 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:00.958920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.001124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf9d44-8d7a-4600-b6a7-41798f142def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.002309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9d44-8d7a-4600-b6a7-41798f142def None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.002898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9d44-8d7a-4600-b6a7-41798f142def None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.003423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf9d44-8d7a-4600-b6a7-41798f142def None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.004473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf9d44-8d7a-4600-b6a7-41798f142def None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:01.005091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf9d44-8d7a-4600-b6a7-41798f142def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.007529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf9d44-8d7a-4600-b6a7-41798f142def None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.019473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 420/836] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:26:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:01.026589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899120e-ab81-4af3-8ec6-e74652a82d34 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.036800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a159b4-50de-4613-bd3f-cbba5a64de75 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.037114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a159b4-50de-4613-bd3f-cbba5a64de75 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.037360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a159b4-50de-4613-bd3f-cbba5a64de75 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.039854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 421/837] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:01.046179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f7a8-c4d4-4317-bf06-ea1dff91c51b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.046667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f7a8-c4d4-4317-bf06-ea1dff91c51b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.047045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9f7a8-c4d4-4317-bf06-ea1dff91c51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.067052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-11b9f7a8-c4d4-4317-bf06-ea1dff91c51b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:01.068480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-11b9f7a8-c4d4-4317-bf06-ea1dff91c51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:01.151752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.166785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899120e-ab81-4af3-8ec6-e74652a82d34 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.178143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 422/838] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:01.201985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9f7a8-c4d4-4317-bf06-ea1dff91c51b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.220513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.221329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.221923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.221923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.234721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.236188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:01.256861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:01.257859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:01.258779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:01.258779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:01.258779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:01.258779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:01.258779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 417/839] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:01.265760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.345925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.355287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9f7a8-c4d4-4317-bf06-ea1dff91c51b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.403667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.404642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.404998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.405348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.406335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.408572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.418487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df022bf-1a63-42a5-b4b7-3466bf2cfda1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:01.425981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:01.427063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:01.427918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:01.433929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 423/840] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:01.434964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.471539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.472870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.473859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.474693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.476291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:01.477082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.479458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.491980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.497419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 418/841] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:01.503551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.564317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb4405-c57f-42b7-b92d-d540fc7ba75a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.608570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.609619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.610150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.610659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.611610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:01.612129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.613687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.619905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 424/842] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:01.626450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.650106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e32062-b7f2-44ae-a280-90a291b73550 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.657497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.688146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.688998 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.689341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.689797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.699687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.701215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:01.716731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:01.718169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 12:26:01.719636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:01.722888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 419/843] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:01.723765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:01.752129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f63c85c-d2cf-4b5a-ac67-d036b1ce4e53 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.790182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:01.793011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.793929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.794417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.795021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.795936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:01.796557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.798182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.804607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 425/844] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:01.847764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f51b5-aee7-4a66-9367-162b25fc722a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:01.888464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:01.889534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:01.890025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:01.890554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:01.891697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:01.892228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:01.894250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:01.922086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 420/845] 10.222.0.60 () {56 vars in 1135 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:01.929016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:02.038768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:02.057184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d858ee-3710-4e62-9cd2-268d9f720935 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:02.099700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806264e-0763-4194-95cb-57b61c50fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:02.101295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806264e-0763-4194-95cb-57b61c50fc3e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.101577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806264e-0763-4194-95cb-57b61c50fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.101850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806264e-0763-4194-95cb-57b61c50fc3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.180061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806264e-0763-4194-95cb-57b61c50fc3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:02.181998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806264e-0763-4194-95cb-57b61c50fc3e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:02.282557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:02.299623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 426/846] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:02.306549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:02.308736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e5ca-22db-464e-ad39-b1eba262d5f5 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.309026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e5ca-22db-464e-ad39-b1eba262d5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.309302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4057e5ca-22db-464e-ad39-b1eba262d5f5 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.311144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 427/847] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:02.317053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966d37-840b-4404-a561-41520ae1e50f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.317421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966d37-840b-4404-a561-41520ae1e50f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.317603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22966d37-840b-4404-a561-41520ae1e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.336689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-22966d37-840b-4404-a561-41520ae1e50f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:02.337912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-22966d37-840b-4404-a561-41520ae1e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:02.419821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 428/848] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:02.425566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc3e55-2bbe-4fa0-936f-a9506b666821 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:02.436136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22966d37-840b-4404-a561-41520ae1e50f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:02.451936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:02.470198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:02.471088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.471377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.471649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.490332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:02.494396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:02.514139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:02.515188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:02.516121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:02.516121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:02.516121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:02.516121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:02.518839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 421/849] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:02.521690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:02.576087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22966d37-840b-4404-a561-41520ae1e50f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:02.601699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:02.627803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:02.628653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.629209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.629493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.630158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:02.632117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:02.648062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde1209-4b80-4aa7-a9b4-9fff9665ac7b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:02.652129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:02.653121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:02.654943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 429/850] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 26 12:26:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:02.659370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:02.698903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:02.700057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.700584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.701049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.702129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:02.702986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:02.705943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:02.723282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 422/851] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:02.729156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:02.765831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:02.806002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7e8da-3dae-43fc-bcdf-95ea3af7827e None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:02.842372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:02.843217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.843619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.843987 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.844800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:02.845207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:02.846732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:02.852184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 430/852] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:02.857387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:02.860366 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d72365-9663-4bc6-8b38-06efbe3e0777 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:02.906892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:02.908267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:02.908812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:02.909265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:02.909911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:02.919203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:02.920649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:02.937605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:02.938592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:02.939494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:02.939494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:02.939494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:02.939494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:02.939494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:02.939494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:02.939494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:02.939494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:02.944191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 423/853] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:02.945373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:02.986139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341f73c-4ff9-48fc-a483-768112f83560 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.033190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.034469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.034965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.035436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.036586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:03.037083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:03.039345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:03.047422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 431/854] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:02 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:03.050022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:03.063740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347f994-4032-4d09-9640-9c4f6085e4ff None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.111166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f7939c-28cb-4ad6-bdc2-05a4c0842370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.112302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7939c-28cb-4ad6-bdc2-05a4c0842370 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.112851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7939c-28cb-4ad6-bdc2-05a4c0842370 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.113325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f7939c-28cb-4ad6-bdc2-05a4c0842370 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.114435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7939c-28cb-4ad6-bdc2-05a4c0842370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:03.115327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7939c-28cb-4ad6-bdc2-05a4c0842370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:03.119082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f7939c-28cb-4ad6-bdc2-05a4c0842370 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:03.140673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 424/855] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:03.147981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:03.277205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb2f2c-10a5-4132-80a6-4cd93b104bfd None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.291150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:03.318160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.319612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.319963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.320289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.321214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=df88788d6691436c983cdb53f5e4c53e) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:03.321532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:03.323063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:03.325647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a45a0-462c-4c4b-890e-301760e34ba7 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.325937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a45a0-462c-4c4b-890e-301760e34ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.326213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a45a0-462c-4c4b-890e-301760e34ba7 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.327852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 425/856] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:03.331217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 432/857] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:03 2022] GET /identity/v3/role_assignments?user.id=df88788d6691436c983cdb53f5e4c53e&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=07de3e1931ca4d799df8510428e181aa => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:03.336724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd60db-4b9c-4106-90f9-90d844ea5434 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.337059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd60db-4b9c-4106-90f9-90d844ea5434 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.337351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd60db-4b9c-4106-90f9-90d844ea5434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.357506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f4dd60db-4b9c-4106-90f9-90d844ea5434 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:03.358782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f4dd60db-4b9c-4106-90f9-90d844ea5434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:03.448682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 426/858] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:03.478298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:03.602349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784cf94-36df-43cb-a61b-193ceb515763 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.640355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c59e1-2c6d-407c-ad11-d78896c68e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.641491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c59e1-2c6d-407c-ad11-d78896c68e62 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.641942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c59e1-2c6d-407c-ad11-d78896c68e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.642406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c59e1-2c6d-407c-ad11-d78896c68e62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.654923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c59e1-2c6d-407c-ad11-d78896c68e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-eb8c59e1-2c6d-407c-ad11-d78896c68e62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:03.663762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:03.664747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:26:03.665627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:03.668052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 433/859] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:26:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:03.673978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd60db-4b9c-4106-90f9-90d844ea5434 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:03.767367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:03.795256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd60db-4b9c-4106-90f9-90d844ea5434 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:03.838825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:03.841371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:03.841873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:03.842381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:03.843533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:03.843847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:03.845247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:03.856371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 427/860] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:26:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:03.870965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c59e1-2c6d-407c-ad11-d78896c68e62 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:03.923725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:04.047197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c59e1-2c6d-407c-ad11-d78896c68e62 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:04.090620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:04.091477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.091760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.092041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.105418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:04.107008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:04.128040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:04.129819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:04.133251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:04.133251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:04.133251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:04.133251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:04.133251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 434/861] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:04.136793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:04.259362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afedc3-f460-426d-8029-db0414819ee2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:04.298860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a28479c-c48c-4dd1-84af-68287bd4fa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:04.299543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28479c-c48c-4dd1-84af-68287bd4fa75 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.299827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28479c-c48c-4dd1-84af-68287bd4fa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.300101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a28479c-c48c-4dd1-84af-68287bd4fa75 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.300836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28479c-c48c-4dd1-84af-68287bd4fa75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:04.301146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28479c-c48c-4dd1-84af-68287bd4fa75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:04.302605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a28479c-c48c-4dd1-84af-68287bd4fa75 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:04.318338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 428/862] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:04.324732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:04.362924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bba47-7fef-4c29-bfe0-46584d6998b0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.363226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bba47-7fef-4c29-bfe0-46584d6998b0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.363413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bba47-7fef-4c29-bfe0-46584d6998b0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.366635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 429/863] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:04.371509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83426fa-8952-4930-91e1-f7a8f1e23fe1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.371843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83426fa-8952-4930-91e1-f7a8f1e23fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.372077 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83426fa-8952-4930-91e1-f7a8f1e23fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.378874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:04.390129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d83426fa-8952-4930-91e1-f7a8f1e23fe1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:04.391459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d83426fa-8952-4930-91e1-f7a8f1e23fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:04.437859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:04.458885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233674fa-c027-45c3-bf9a-5ffec28e97a9 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:04.485183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 430/864] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:04.508465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83426fa-8952-4930-91e1-f7a8f1e23fe1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:04.515011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:04.516161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.516709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.517304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.526944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:04.528944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:04.547631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:04.548685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:26:04.549677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:04.552506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 435/865] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:26:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:04.562571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:04.619939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83426fa-8952-4930-91e1-f7a8f1e23fe1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:04.657747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:04.664482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bfa5b-f258-4b23-9489-7481904bc4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:04.665384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bfa5b-f258-4b23-9489-7481904bc4e1 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.665811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bfa5b-f258-4b23-9489-7481904bc4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.666243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6bfa5b-f258-4b23-9489-7481904bc4e1 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.667158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bfa5b-f258-4b23-9489-7481904bc4e1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:04.668702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6bfa5b-f258-4b23-9489-7481904bc4e1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:04.703920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614b55c6-0bfe-4bf2-aee5-ce881da115ac None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:04.744360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:04.745040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.745312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.745583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:04.746417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:04.746744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:04.748181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:04.767151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 431/866] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:26:04 2022] POST /identity/v3/services => generated 251 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:26:04.777270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 436/867] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 26 12:26:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:04.778783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bfa5b-f258-4b23-9489-7481904bc4e1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:04.923888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6bfa5b-f258-4b23-9489-7481904bc4e1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:04.973112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c92cb-e2bb-4222-94ce-9b477148528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:04.974154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c92cb-e2bb-4222-94ce-9b477148528e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:04.974720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c92cb-e2bb-4222-94ce-9b477148528e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:04.975741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c92cb-e2bb-4222-94ce-9b477148528e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:05.043796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:05.060409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c92cb-e2bb-4222-94ce-9b477148528e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:05.062358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c92cb-e2bb-4222-94ce-9b477148528e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:05.181400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 432/868] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:04 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:05.186721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:05.191301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:05.320516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02446b91-2249-42bd-8643-b7e768c0e910 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:05.378557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:05.378557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:05.378557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:05.378557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:05.403690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:05.406174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:05.459431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:05.460382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:05.461333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:05.461333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:05.461333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:05.461333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:05.474644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c92cb-e2bb-4222-94ce-9b477148528e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:05.475372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 437/869] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:05.595112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:05.607677 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c92cb-e2bb-4222-94ce-9b477148528e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:05.673235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed551937-5cf0-431c-bc3d-d45d8d48e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:05.673918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551937-5cf0-431c-bc3d-d45d8d48e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:05.674198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551937-5cf0-431c-bc3d-d45d8d48e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:05.674467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed551937-5cf0-431c-bc3d-d45d8d48e5d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:05.675636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed551937-5cf0-431c-bc3d-d45d8d48e5d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:05.675968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed551937-5cf0-431c-bc3d-d45d8d48e5d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:05.677341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed551937-5cf0-431c-bc3d-d45d8d48e5d8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:05.699224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 433/870] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:05.712356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:05.736459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abea15-fc3a-4a12-acc4-ac5e7b1afa12 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:05.736769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abea15-fc3a-4a12-acc4-ac5e7b1afa12 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:05.737018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abea15-fc3a-4a12-acc4-ac5e7b1afa12 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:05.738567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 434/871] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:05.749698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbd04d-a781-4ec4-b761-06ccf2ca3876 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:05.749698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbd04d-a781-4ec4-b761-06ccf2ca3876 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:05.749698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcbd04d-a781-4ec4-b761-06ccf2ca3876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:05.784424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bfcbd04d-a781-4ec4-b761-06ccf2ca3876 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:05.786483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bfcbd04d-a781-4ec4-b761-06ccf2ca3876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:05.808295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:05.922843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddbda5-ce9b-4504-8bf8-e08e0114aad0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:05.941279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 435/872] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:05 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:05.968152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbd04d-a781-4ec4-b761-06ccf2ca3876 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.008069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.010266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.010588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.010866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.028898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.032767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:06.054899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:06.055907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:06.056818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 438/873] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:06.065357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.092449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.116166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcbd04d-a781-4ec4-b761-06ccf2ca3876 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.153825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aee58d-c491-4574-b775-f601052ad2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.154894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aee58d-c491-4574-b775-f601052ad2aa None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.155326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aee58d-c491-4574-b775-f601052ad2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.155770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aee58d-c491-4574-b775-f601052ad2aa None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.156507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aee58d-c491-4574-b775-f601052ad2aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.157937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aee58d-c491-4574-b775-f601052ad2aa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.205607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712c9e-fe94-4f85-b078-edf555ea437a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.223085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.242273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36e764-ea41-4bdb-adae-cd60d515658d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.242985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e764-ea41-4bdb-adae-cd60d515658d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.243265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e764-ea41-4bdb-adae-cd60d515658d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.243541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36e764-ea41-4bdb-adae-cd60d515658d None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.244318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36e764-ea41-4bdb-adae-cd60d515658d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:06.244622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36e764-ea41-4bdb-adae-cd60d515658d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.246034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36e764-ea41-4bdb-adae-cd60d515658d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.260830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 439/874] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:06.260830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d2c9-9d84-48ed-b5a0-5696f83b0a87 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.260830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d2c9-9d84-48ed-b5a0-5696f83b0a87 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.260830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd4d2c9-9d84-48ed-b5a0-5696f83b0a87 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.266112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 440/875] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:06.266112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d2c9-9d84-48ed-b5a0-5696f83b0a87 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.284414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 436/876] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:26:05 2022] POST /identity/v3/services => generated 269 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:26:06.285605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685ab4-e695-4d99-9a41-b4f300e8401e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.285900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685ab4-e695-4d99-9a41-b4f300e8401e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.286221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685ab4-e695-4d99-9a41-b4f300e8401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.307971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-88685ab4-e695-4d99-9a41-b4f300e8401e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:06.309127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-88685ab4-e695-4d99-9a41-b4f300e8401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:06.410898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 437/877] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:06.431000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88685ab4-e695-4d99-9a41-b4f300e8401e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.433275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd4d2c9-9d84-48ed-b5a0-5696f83b0a87 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.473615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.474645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.475662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.476086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.478137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=709a912079c747838254b83f06568cca) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:06.478699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.480449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.488868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 441/878] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/role_assignments?user.id=709a912079c747838254b83f06568cca&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:06.525362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.579483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88685ab4-e695-4d99-9a41-b4f300e8401e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.619491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.620435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.620768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.621047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.621715 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.623126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:06.637320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:06.638380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:06.639282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 438/879] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:06.645421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.695603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.762096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ae1af-1fac-4e82-9cb8-d9017fdee3af None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.802742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10305481-e116-4313-9295-2033d8383f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.803519 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305481-e116-4313-9295-2033d8383f46 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.803780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305481-e116-4313-9295-2033d8383f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.804042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10305481-e116-4313-9295-2033d8383f46 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.804753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305481-e116-4313-9295-2033d8383f46 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:06.805060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305481-e116-4313-9295-2033d8383f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.806422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10305481-e116-4313-9295-2033d8383f46 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.812037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 442/880] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:06.817915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:06.929582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecc0a3-8525-425d-b01e-5c9ff03afea7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:06.958316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:06.967250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e07fe-4ddd-439e-a70b-ca009518e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:06.967927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e07fe-4ddd-439e-a70b-ca009518e139 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:06.978423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e07fe-4ddd-439e-a70b-ca009518e139 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:06.978423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e07fe-4ddd-439e-a70b-ca009518e139 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:06.978423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e07fe-4ddd-439e-a70b-ca009518e139 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:06.978423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e07fe-4ddd-439e-a70b-ca009518e139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:06.978423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e07fe-4ddd-439e-a70b-ca009518e139 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:06.978423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 439/881] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:06 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:07.607166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c447d-a188-42cb-aa9d-293a1414dc43 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:07.608072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c447d-a188-42cb-aa9d-293a1414dc43 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:07.608072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c447d-a188-42cb-aa9d-293a1414dc43 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:07.609256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 443/882] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:07.614698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3b75-a105-4b40-a675-b1d5f99503dd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:07.614989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3b75-a105-4b40-a675-b1d5f99503dd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:07.615274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a3b75-a105-4b40-a675-b1d5f99503dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:07.636070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f48a3b75-a105-4b40-a675-b1d5f99503dd None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:07.637317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f48a3b75-a105-4b40-a675-b1d5f99503dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:07.713429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 440/883] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:07.737784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c447d-a188-42cb-aa9d-293a1414dc43 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:07.863585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c447d-a188-42cb-aa9d-293a1414dc43 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:07.867474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:07.905598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:07.906408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:07.906719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:07.906994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:07.907657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:07.909042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:07.926381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:07.928825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:07.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 444/884] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:07.934403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a3b75-a105-4b40-a675-b1d5f99503dd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:08.050775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a3b75-a105-4b40-a675-b1d5f99503dd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:08.078904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:08.091613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:08.092304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.092589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.092905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.093913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:08.094232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:08.095700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:08.102185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 441/885] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:08.108198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:08.268070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa505cc-4dde-45b2-aa43-5c214d7ce694 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:08.307708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:08.308449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.308738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.309013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.309794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:08.310101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:08.311627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:08.317695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 445/886] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:08.324377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:08.451885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a0fff-b825-43f1-868c-d5b7099f78e6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:08.491986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15e698-1cdd-46e6-9bfe-d5c94f5ff04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:08.492674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e698-1cdd-46e6-9bfe-d5c94f5ff04e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.492959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e698-1cdd-46e6-9bfe-d5c94f5ff04e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.493226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15e698-1cdd-46e6-9bfe-d5c94f5ff04e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.494038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15e698-1cdd-46e6-9bfe-d5c94f5ff04e None admin] RBAC: Adding query filter params (interface=public, service_id=3f6ba93742a04ae5b2e59022493cf65f, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:08.494354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15e698-1cdd-46e6-9bfe-d5c94f5ff04e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:08.495774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15e698-1cdd-46e6-9bfe-d5c94f5ff04e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:08.502199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 442/887] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 26 12:26:08 2022] GET /identity/v3/endpoints?service_id=3f6ba93742a04ae5b2e59022493cf65f&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:08.511659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:08.556054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:08.648381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8c045-33a5-4fff-9c82-a85652bbd643 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:08.686512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadeb60-f1c8-4c3b-90bd-cae1f30da8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:08.687234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadeb60-f1c8-4c3b-90bd-cae1f30da8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.687513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadeb60-f1c8-4c3b-90bd-cae1f30da8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.687794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadeb60-f1c8-4c3b-90bd-cae1f30da8d5 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.688496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadeb60-f1c8-4c3b-90bd-cae1f30da8d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:08.689940 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadeb60-f1c8-4c3b-90bd-cae1f30da8d5 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:08.697847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 446/888] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:26:08 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:26:08.899401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f46c-eee4-4fb0-b9e1-b27763f1fadc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.899401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f46c-eee4-4fb0-b9e1-b27763f1fadc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.899401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0f46c-eee4-4fb0-b9e1-b27763f1fadc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.899401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 443/889] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:08.906142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29d28-8070-43a2-a959-1408273dcb69 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:08.906366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29d28-8070-43a2-a959-1408273dcb69 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:08.906665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd29d28-8070-43a2-a959-1408273dcb69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:08.928720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-edd29d28-8070-43a2-a959-1408273dcb69 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:08.930956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-edd29d28-8070-43a2-a959-1408273dcb69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:09.026100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 447/890] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:09.050014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f46c-eee4-4fb0-b9e1-b27763f1fadc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.114612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.149999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0721e0-1a3e-4e05-ad1e-e79109db007e None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.150346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0721e0-1a3e-4e05-ad1e-e79109db007e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.150874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0721e0-1a3e-4e05-ad1e-e79109db007e None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.155436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 448/891] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:09.161917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfc48-099c-4528-bd4f-f3038149d076 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.163281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfc48-099c-4528-bd4f-f3038149d076 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.163971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489bfc48-099c-4528-bd4f-f3038149d076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.196374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-489bfc48-099c-4528-bd4f-f3038149d076 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:09.198957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-489bfc48-099c-4528-bd4f-f3038149d076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:09.199483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0f46c-eee4-4fb0-b9e1-b27763f1fadc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.226046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.237902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.238768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.245101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.245101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.245101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.245101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:09.255668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:09.257790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:09.263263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 444/892] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:09.272786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.313069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 449/893] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:09.338758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bfc48-099c-4528-bd4f-f3038149d076 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.417367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efacab-697d-424c-b545-536f054b40e3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.441137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.459150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489bfc48-099c-4528-bd4f-f3038149d076 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.468539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.469560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.470005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.470484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.471468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:09.471947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.473493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.481156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 445/894] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:09.486623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.516122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff702c4a-136d-48f4-b2ae-7a6d76ddad27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.517580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff702c4a-136d-48f4-b2ae-7a6d76ddad27 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.518110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff702c4a-136d-48f4-b2ae-7a6d76ddad27 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.518951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff702c4a-136d-48f4-b2ae-7a6d76ddad27 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.536440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff702c4a-136d-48f4-b2ae-7a6d76ddad27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-ff702c4a-136d-48f4-b2ae-7a6d76ddad27 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:09.551973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:09.553684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:09.554671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:09.557746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 450/895] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:09.565212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff702c4a-136d-48f4-b2ae-7a6d76ddad27 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.604278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.624471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad96bbd-888a-4cd4-82d3-19c5b7c1ff30 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.681151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd641267-b258-4746-99e5-f9485350c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.682173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd641267-b258-4746-99e5-f9485350c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.682492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd641267-b258-4746-99e5-f9485350c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.682798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd641267-b258-4746-99e5-f9485350c5e9 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.684503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd641267-b258-4746-99e5-f9485350c5e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:09.685079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd641267-b258-4746-99e5-f9485350c5e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.686894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd641267-b258-4746-99e5-f9485350c5e9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.692584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 446/896] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:09.695624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471d2e-150b-42dc-b0bc-9a3bfb04244e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.696048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471d2e-150b-42dc-b0bc-9a3bfb04244e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.696431 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd471d2e-150b-42dc-b0bc-9a3bfb04244e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.698599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 447/897] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:09.700384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd471d2e-150b-42dc-b0bc-9a3bfb04244e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.737405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff702c4a-136d-48f4-b2ae-7a6d76ddad27 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.766550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.776241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdd84a-05d6-4ce9-9eb4-48ad64ade2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.776970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd84a-05d6-4ce9-9eb4-48ad64ade2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.782706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd84a-05d6-4ce9-9eb4-48ad64ade2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.782706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdd84a-05d6-4ce9-9eb4-48ad64ade2f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.782706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdd84a-05d6-4ce9-9eb4-48ad64ade2f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:09.782706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdd84a-05d6-4ce9-9eb4-48ad64ade2f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.782706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdd84a-05d6-4ce9-9eb4-48ad64ade2f1 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.793206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 451/898] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:09.793206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617f5e4-61c4-4896-93ee-d8df9a181a4f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.793206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617f5e4-61c4-4896-93ee-d8df9a181a4f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.793206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617f5e4-61c4-4896-93ee-d8df9a181a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.813623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5617f5e4-61c4-4896-93ee-d8df9a181a4f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:09.815081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5617f5e4-61c4-4896-93ee-d8df9a181a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:09.867852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd471d2e-150b-42dc-b0bc-9a3bfb04244e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:09.900298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 452/899] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:09.906826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617f5e4-61c4-4896-93ee-d8df9a181a4f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:09.911385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:09.937979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:09.938589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:09.938873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:09.939899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:09.940062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] RBAC: Adding query filter params (interface=public, service_id=b8d2b0063d7a450d909b5d55f3c33922, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:09.940295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:09.944823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:09.956152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 448/900] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/endpoints?service_id=b8d2b0063d7a450d909b5d55f3c33922&interface=public®ion_id=RegionOne => generated 194 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:09.956152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.028621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617f5e4-61c4-4896-93ee-d8df9a181a4f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.068660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.069535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.069816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.070086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.075442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450c672-0bc0-44d0-b4c7-f048bd61b6ba None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.081272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.082769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.085296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:10.101882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:10.102993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:10.104444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:10.104444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:10.104444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:10.104444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:10.104444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 453/901] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:10.104444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.127933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a37b56-224b-4f5d-9747-790787812319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.128618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a37b56-224b-4f5d-9747-790787812319 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.128903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a37b56-224b-4f5d-9747-790787812319 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.129176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a37b56-224b-4f5d-9747-790787812319 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.129948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a37b56-224b-4f5d-9747-790787812319 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.131336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a37b56-224b-4f5d-9747-790787812319 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.199438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 449/902] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:26:09 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:10.200167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a37b56-224b-4f5d-9747-790787812319 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.203038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:10.273327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8013e39-b2ee-4509-b735-2c01eeb43db2 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.331099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a8a0-6a3b-4ece-bfc9-77dd0e14fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.331775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a8a0-6a3b-4ece-bfc9-77dd0e14fb45 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.332201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a8a0-6a3b-4ece-bfc9-77dd0e14fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.332475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67a8a0-6a3b-4ece-bfc9-77dd0e14fb45 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.333260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a8a0-6a3b-4ece-bfc9-77dd0e14fb45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.335306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67a8a0-6a3b-4ece-bfc9-77dd0e14fb45 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.341814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a37b56-224b-4f5d-9747-790787812319 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.343169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 454/903] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:26:10 2022] GET /identity/v3/services => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:26:10.388371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.389083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.389369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.389649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.390423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:10.390770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.392239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.408887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 450/904] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:10.420860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a8a0-6a3b-4ece-bfc9-77dd0e14fb45 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.544351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67a8a0-6a3b-4ece-bfc9-77dd0e14fb45 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.571041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:10.585742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.586600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.586887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.587220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.595513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.596939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:10.614070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:10.615764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:26:10.616743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:10.619288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 455/905] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:26:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:10.622067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.661941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:10.748249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcc5ac-417c-417b-91b0-a961999a0af8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.798205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.798841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.799126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.799401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:10.800247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:10.800555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:10.802028 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:10.824655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 451/906] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 26 12:26:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:10.830224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:10.938181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d7265-5671-42d6-9a98-0cd3fb982cd7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:10.989066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8272076-681a-42f7-9e05-dfaf85816715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:10.990065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8272076-681a-42f7-9e05-dfaf85816715 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:10.993144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8272076-681a-42f7-9e05-dfaf85816715 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:10.993144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8272076-681a-42f7-9e05-dfaf85816715 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.055803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:11.080404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8272076-681a-42f7-9e05-dfaf85816715 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:11.081976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8272076-681a-42f7-9e05-dfaf85816715 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:11.190640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 456/907] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:10 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:11.196106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:11.261699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f18a1-71d0-45a3-8ca3-b9a39d022e83 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.262038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f18a1-71d0-45a3-8ca3-b9a39d022e83 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.262244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f18a1-71d0-45a3-8ca3-b9a39d022e83 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.263977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 457/908] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:11.273197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ebfcc-1cba-4528-a059-33c691c72603 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.273478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ebfcc-1cba-4528-a059-33c691c72603 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.273750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ebfcc-1cba-4528-a059-33c691c72603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.298953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-115ebfcc-1cba-4528-a059-33c691c72603 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:11.300739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-115ebfcc-1cba-4528-a059-33c691c72603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:11.316947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:11.339783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ccf5f-527e-4b5b-90df-b2afbe48b2ab None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:11.383990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:11.384610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 458/909] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:11.384843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.385237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.385597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.407117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:11.413808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:11.422003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ebfcc-1cba-4528-a059-33c691c72603 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:11.441722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:11.456085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:11.473542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:11.474467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:11.474467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:11.474467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:11.474467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:11.474467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 452/910] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:11.474467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:11.564798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ebfcc-1cba-4528-a059-33c691c72603 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:11.610498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:11.611684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.611970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf293ca7-d35d-4c4d-b4ae-2005a6923063 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:11.612399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.612873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.614025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:11.616629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:11.635405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:11.636462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 12:26:11.637384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:11.645819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 459/911] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:11.648500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:11.663012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:11.663737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.664118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.664549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.665427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:11.666324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:11.667460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:11.671209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:11.686992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 453/912] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:11.688828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:11.798513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:11.815340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f794aed-804b-452c-aae9-0767edb97ffe None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:11.847637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4e037-0722-4494-8498-f18502bba7ba None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:11.856945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:11.858100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.858628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.859132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.868180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:11.870072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:11.886665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:11.887612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:11.888493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:11.888493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:11.888493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:11.888493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:11.888493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:11.888493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:11.888493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:11.888493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:11.896152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 454/913] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:11.898173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:11.914675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:11.915833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:11.916338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:11.916923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:11.918163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:11.918745 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:11.921679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:11.936534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 460/914] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:11.937848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:11.976543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:12.036433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b13b1-16a7-41a2-953a-096ac45b2b3b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.075253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414e21f-f9c4-4a5c-8e13-11a8d748c7b6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.077922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.078887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.079374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.079861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.080863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:12.081371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.083173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.102638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 455/915] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:12.104058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:12.116218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.117028 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.117315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.117708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.118980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:12.119231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.120940 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.132971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 461/916] 10.222.0.60 () {56 vars in 1114 bytes} [Thu May 26 12:26:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:12.135447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:12.138933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:12.244790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfffac4b-820f-4f1f-8c00-0d6b8732886d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.272924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fbde6-945c-44ae-a373-798b93c1addc None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:12.282272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:12.309972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c462c9e8-d2de-44ce-a834-a7e5a6218211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.311879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462c9e8-d2de-44ce-a834-a7e5a6218211 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.312186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462c9e8-d2de-44ce-a834-a7e5a6218211 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.312948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462c9e8-d2de-44ce-a834-a7e5a6218211 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.314100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462c9e8-d2de-44ce-a834-a7e5a6218211 None admin] RBAC: Adding query filter params (role.id=6f1199c39ce64672bbee1aac2d5311c6, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=709a912079c747838254b83f06568cca) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:12.314449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462c9e8-d2de-44ce-a834-a7e5a6218211 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.318283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c462c9e8-d2de-44ce-a834-a7e5a6218211 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.330692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 456/917] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:12 2022] GET /identity/v3/role_assignments?user.id=709a912079c747838254b83f06568cca&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=6f1199c39ce64672bbee1aac2d5311c6 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:12.341191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18345be4-16ca-4b30-94af-6d2f455e886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:12.341906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18345be4-16ca-4b30-94af-6d2f455e886f None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.342193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18345be4-16ca-4b30-94af-6d2f455e886f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.342472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18345be4-16ca-4b30-94af-6d2f455e886f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.343414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18345be4-16ca-4b30-94af-6d2f455e886f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:12.344932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18345be4-16ca-4b30-94af-6d2f455e886f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:12.428635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 462/918] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:26:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:26:12.854040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bed36-b82d-4ff5-8360-be1ea4f6149c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.854236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bed36-b82d-4ff5-8360-be1ea4f6149c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.854511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828bed36-b82d-4ff5-8360-be1ea4f6149c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.855902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 457/919] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:12.862008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d895-8e61-436c-9db9-df728fe049dd None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.862495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d895-8e61-436c-9db9-df728fe049dd None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.862744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d895-8e61-436c-9db9-df728fe049dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.881761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5505d895-8e61-436c-9db9-df728fe049dd None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:12.883278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5505d895-8e61-436c-9db9-df728fe049dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:12.883856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce48e6-c3a2-476c-aab7-2ab9f8721af2 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.884153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce48e6-c3a2-476c-aab7-2ab9f8721af2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.884547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce48e6-c3a2-476c-aab7-2ab9f8721af2 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.886232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 458/920] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:12.891875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602e3e-15fa-40f6-81a4-7123ff9b0edf None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:12.892163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602e3e-15fa-40f6-81a4-7123ff9b0edf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:12.892446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38602e3e-15fa-40f6-81a4-7123ff9b0edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:12.911228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-38602e3e-15fa-40f6-81a4-7123ff9b0edf None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:12.913006 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-38602e3e-15fa-40f6-81a4-7123ff9b0edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:12.946715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:12.970104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 463/921] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:13.001646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 459/922] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:13.012410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505d895-8e61-436c-9db9-df728fe049dd None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.025847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38602e3e-15fa-40f6-81a4-7123ff9b0edf None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.131114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505d895-8e61-436c-9db9-df728fe049dd None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.154053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38602e3e-15fa-40f6-81a4-7123ff9b0edf None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.194930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.204416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.207234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.207234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.207234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.207675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.209895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.212119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.213465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.214269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.214733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.215702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.218611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:13.230145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:13.232315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 12:26:13.234290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:13.237911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 464/923] 10.222.0.60 () {56 vars in 1132 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:13.244283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:13.246214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:13.247550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:13.248389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:13.252205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 460/924] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:13.258743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.327910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.388702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f26029-6b89-4e3b-9b7a-5b229fea345c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.390227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5fcc1-3e24-4d59-b69b-261b26fc4ce2 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.427528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.428579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.429040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.429558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.430575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:13.431039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.431393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.432178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.432585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.432931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.433721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:13.434102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.434704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.435740 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.446240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 461/925] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:13.447237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 465/926] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:13.448378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.448516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.494457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.576925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6719709-69ab-45d1-8ac4-29d97a0c8bf0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.597547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32417665-3d47-4c33-a4f3-0c5b49df0a08 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.615956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.617900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.619037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.619037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.619474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.620269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:13.620647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.622112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.633423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 462/927] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:13.634462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.648578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.649860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.650401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.650987 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.651971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:13.652580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.654256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.666139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 466/928] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:13.667559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.757781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb252d-ad9c-468c-9bdb-53afe5045b20 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.759275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:13.786250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442d6b6-1d41-46c2-8c91-980516fdfa7d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.798469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.799174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.799458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.799735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.800644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] RBAC: Adding query filter params (interface=public, service_id=059cf93c8c0543e19626dcb751598a85, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:13.800960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.802340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.813478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 463/929] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/endpoints?service_id=059cf93c8c0543e19626dcb751598a85&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:13.814475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:13.828565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b0263-f5b4-4039-b58d-9085235b6448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.829608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0263-f5b4-4039-b58d-9085235b6448 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.830093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0263-f5b4-4039-b58d-9085235b6448 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.830591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b0263-f5b4-4039-b58d-9085235b6448 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.831654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b0263-f5b4-4039-b58d-9085235b6448 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.833343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b0263-f5b4-4039-b58d-9085235b6448 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.923126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 467/930] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:26:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:13.929416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018c00c-613c-4fb9-8c12-d977b7a49787 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:13.979364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a216e5-7487-4aca-931e-71a43035937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:13.980054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a216e5-7487-4aca-931e-71a43035937d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:13.980339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a216e5-7487-4aca-931e-71a43035937d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:13.980620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a216e5-7487-4aca-931e-71a43035937d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:13.981307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a216e5-7487-4aca-931e-71a43035937d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:13.982741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a216e5-7487-4aca-931e-71a43035937d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:13.990111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 464/931] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:26:13 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:26:14.817340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d871-1e6e-4ee5-be25-1896749af726 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:14.817777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d871-1e6e-4ee5-be25-1896749af726 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:14.817883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42d871-1e6e-4ee5-be25-1896749af726 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:14.819769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 468/932] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:14.825442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294a35-cad1-4a59-803f-a0f33fad425b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:14.825958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294a35-cad1-4a59-803f-a0f33fad425b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:14.826046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84294a35-cad1-4a59-803f-a0f33fad425b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:14.845278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-84294a35-cad1-4a59-803f-a0f33fad425b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:14.846554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-84294a35-cad1-4a59-803f-a0f33fad425b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:14.871597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:14.928772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 465/933] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:14.954265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d871-1e6e-4ee5-be25-1896749af726 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:14.987141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.057483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0aa26-7c58-4b83-8985-3b0e55b748b7 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.057810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0aa26-7c58-4b83-8985-3b0e55b748b7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.058066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0aa26-7c58-4b83-8985-3b0e55b748b7 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.060949 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 466/934] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:15.064847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42d871-1e6e-4ee5-be25-1896749af726 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.065281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e031-6204-4d6c-8fb9-3e8d209d27d7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.065569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e031-6204-4d6c-8fb9-3e8d209d27d7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.065849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e031-6204-4d6c-8fb9-3e8d209d27d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.082854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b6e9e031-6204-4d6c-8fb9-3e8d209d27d7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:15.084579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b6e9e031-6204-4d6c-8fb9-3e8d209d27d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:15.105119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05ba4d-8afb-4fdc-b85c-4660b021e3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.106254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ba4d-8afb-4fdc-b85c-4660b021e3ed None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.106867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ba4d-8afb-4fdc-b85c-4660b021e3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.107305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05ba4d-8afb-4fdc-b85c-4660b021e3ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.119728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b05ba4d-8afb-4fdc-b85c-4660b021e3ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-6b05ba4d-8afb-4fdc-b85c-4660b021e3ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:15.128489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:15.129472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:15.131126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 469/935] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 26 12:26:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:15.135548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05ba4d-8afb-4fdc-b85c-4660b021e3ed None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.168168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 467/936] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:15.195317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9e031-6204-4d6c-8fb9-3e8d209d27d7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.272183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.281960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b05ba4d-8afb-4fdc-b85c-4660b021e3ed None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.314388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.325694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.326377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.326690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.326957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.327704 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:15.328114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.329492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.340287 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9e031-6204-4d6c-8fb9-3e8d209d27d7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.341664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 470/937] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:15.356003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.382119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.383195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.383673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.384094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.385103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.386726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.388347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING keystone.server.flask.common [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 12:26:15.437973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.sql.core [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:26:15.437973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:26:15.437973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [parameters: {'id': 'ef312ff5353a4775bbd0c4dfc8855fd0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:26:15.437973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80388) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef312ff5353a4775bbd0c4dfc8855fd0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef312ff5353a4775bbd0c4dfc8855fd0. May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application conn.query(q) May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:26:15.459604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result.read() May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 12:26:15.460683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application next(self.gen) May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application yield resource May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application next(self.gen) May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise self.value May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application session.commit() May 26 12:26:15.461884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.session.flush() May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application compat.raise_( May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:26:15.463312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:26:15.464458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application conn.query(q) May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application result.read() May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:26:15.465433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [parameters: {'id': 'ef312ff5353a4775bbd0c4dfc8855fd0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:15.466485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:15.467666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ef312ff5353a4775bbd0c4dfc8855fd0. May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 468/938] 10.222.0.60 () {60 vars in 1140 bytes} [Thu May 26 12:26:15 2022] POST /identity/v3/projects => generated 262 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:15.470477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.500423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9c79b-b9a3-4863-ad32-11942ab9c715 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.562355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.563494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.563978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.564400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.580565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.582259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.600767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b7dd3-645a-40de-8665-c79becb20fad None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:15.605205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:15.606300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:15.607475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:15.607475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:15.607475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:15.607475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:15.613513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 471/939] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:15.614788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.626887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.651831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.652910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.653290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.653691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.661727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.664432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:15.682220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:15.683248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:15.684137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 469/940] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:15.689234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.695658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:15.750369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4336bc-2ac1-44d2-a21f-aa1dfd0b3a4a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.812558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.813844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.814574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.815033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.816016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:15.816476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.817619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01850257-53a9-4f12-81a8-37dfcc22dfdd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:15.818193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.841287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 472/941] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:15.843289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:15.885407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:15.886479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:15.886995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:15.887475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:15.888822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:15.889355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:15.891613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:15.923847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 470/942] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:15.955446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:16.009005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae63a1d-ae68-4d36-93a9-6c827765e908 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:16.062960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:16.063818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.064100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.064378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.074421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:16.075980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:16.093500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:16.094510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:16.095472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 473/943] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:26:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:16.103684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:16.189788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:16.231536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaed73f-f083-43ad-a9dc-2e45dd289a7b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:16.287760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb9965-c682-4d85-951c-7beb4e2eb917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:16.289298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9965-c682-4d85-951c-7beb4e2eb917 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.289828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9965-c682-4d85-951c-7beb4e2eb917 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.290288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb9965-c682-4d85-951c-7beb4e2eb917 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.291446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb9965-c682-4d85-951c-7beb4e2eb917 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:16.292143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb9965-c682-4d85-951c-7beb4e2eb917 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:16.294769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb9965-c682-4d85-951c-7beb4e2eb917 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:16.322751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 471/944] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 26 12:26:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:16.329105 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:16.465133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc7591-ba64-4389-872b-0fb1057e2e67 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:16.493649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:16.496257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65689be-a2c3-4351-a678-f49e5f4f7b04 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.496554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65689be-a2c3-4351-a678-f49e5f4f7b04 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.496839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65689be-a2c3-4351-a678-f49e5f4f7b04 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.498473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 472/945] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:16.502490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:16.503382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.503669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.508696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.508813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bac09f-8ef6-4182-83da-52febb4c0c70 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.508813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bac09f-8ef6-4182-83da-52febb4c0c70 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.508813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bac09f-8ef6-4182-83da-52febb4c0c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.519922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:16.522324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:16.527620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-16bac09f-8ef6-4182-83da-52febb4c0c70 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:16.529493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-16bac09f-8ef6-4182-83da-52febb4c0c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:16.546895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:16.547909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:16.548789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:16.548789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:16.548789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:16.548789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:16.548789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 474/946] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:16.560124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:16.639528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 473/947] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:16.641278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72912924-6ef2-426f-9063-058a5dbee231 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.641707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72912924-6ef2-426f-9063-058a5dbee231 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.642118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72912924-6ef2-426f-9063-058a5dbee231 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.644864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 474/948] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:16.650890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb35d6-ce06-413a-9488-64392e8e1809 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.651239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb35d6-ce06-413a-9488-64392e8e1809 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.651502 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb35d6-ce06-413a-9488-64392e8e1809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.670340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f3cb35d6-ce06-413a-9488-64392e8e1809 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:16.671743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f3cb35d6-ce06-413a-9488-64392e8e1809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:16.725700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956822b-7c0d-4124-8c8f-2716b0cfaca4 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:16.737098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:16.773258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:16.773971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.774254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.774558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.786568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:16.786568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:16.786876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 475/949] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:16.786967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:16.787577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb35d6-ce06-413a-9488-64392e8e1809 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:16.801812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 475/950] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:16.802563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:16.887238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:16.933851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb35d6-ce06-413a-9488-64392e8e1809 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:16.964472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91b8e0-e47a-44cc-a3f4-e2fc948f86a5 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:16.977357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:16.978400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:16.978953 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:16.979383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:16.980172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:16.981698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:16.995378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:16.996640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:16.997565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 476/951] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:16.998469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.009146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.011119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.011602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.012061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.013649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.016449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:17.031029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:17.032183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:17.033112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 476/952] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:17.035139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.063906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:17.152675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dad962-e7ce-40a5-92f5-ca54f50661c3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.156273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8967415-f9d9-4bd1-8a0e-f7d36cd80de7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.157888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:17.194645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.195808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.196106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.196479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.200498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.201168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.201450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.201726 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.202497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:17.202878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.204612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.204712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.206225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.212252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 477/953] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:17.213261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:17.234679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:17.235890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 477/954] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:17.243288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.356269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12369928-6b6e-404a-b292-a9628265d74b None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.381487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc8a80-e68f-4b34-840e-0bef0cd852f8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.384299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:17.404882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.405575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.405858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.406131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.407058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] RBAC: Adding query filter params (name=compute) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:17.407250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.408679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.420985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 478/955] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:26:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:17.420985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.430849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.432224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.432508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.432793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.433504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:17.433813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.435629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.446893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 478/956] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:17.446893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.462966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:17.553239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4ef8e1-f9f7-4b55-93cf-2c87e75c22fc None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.558775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe84178-dfe6-4e3c-86ad-38828bfde08d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.595184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.595974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.596254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.596527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.597317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:17.597623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.598995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.599116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.600300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.600717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.601016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.601965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:17.602269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.604109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.618692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 479/957] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:26:17 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:17.618692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.618954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 479/958] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:17.619034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:17.667456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:17.757768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:17.769586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74e0bda-7a59-4a0f-92fc-b59e43d7239a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.774985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a5690-9cf6-4f5c-8693-15452986c5d8 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:17.822090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a82a9-a22f-4a1e-8e75-089287d6b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.822980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a82a9-a22f-4a1e-8e75-089287d6b901 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.823258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a82a9-a22f-4a1e-8e75-089287d6b901 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.823530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a82a9-a22f-4a1e-8e75-089287d6b901 None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/709a912079c747838254b83f06568cca/roles/6f1199c39ce64672bbee1aac2d5311c6` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.825310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f910-9133-416b-a8aa-18e525a5a983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:17.825987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f910-9133-416b-a8aa-18e525a5a983 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:17.826186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a82a9-a22f-4a1e-8e75-089287d6b901 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=709a912079c747838254b83f06568cca, role_id=6f1199c39ce64672bbee1aac2d5311c6)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.826302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f910-9133-416b-a8aa-18e525a5a983 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:17.826595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f910-9133-416b-a8aa-18e525a5a983 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:17.827321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f910-9133-416b-a8aa-18e525a5a983 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:17.827665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a82a9-a22f-4a1e-8e75-089287d6b901 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.828672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f910-9133-416b-a8aa-18e525a5a983 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:17.935821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 480/959] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:26:17 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/709a912079c747838254b83f06568cca/roles/6f1199c39ce64672bbee1aac2d5311c6 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:26:17.962138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 480/960] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:26:17 2022] POST /identity/v3/endpoints => generated 349 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:18.630938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe85ac-8035-4fac-a957-fa1a5c9ea60c None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:18.632219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe85ac-8035-4fac-a957-fa1a5c9ea60c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:18.632219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe85ac-8035-4fac-a957-fa1a5c9ea60c None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:18.633891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 481/961] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:18.640062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045573ee-9079-4696-93cd-a292aa671416 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:18.640642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045573ee-9079-4696-93cd-a292aa671416 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:18.641115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045573ee-9079-4696-93cd-a292aa671416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:18.663608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-045573ee-9079-4696-93cd-a292aa671416 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:18.665220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-045573ee-9079-4696-93cd-a292aa671416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:18.774647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 481/962] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:18.795687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe85ac-8035-4fac-a957-fa1a5c9ea60c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:18.918365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe85ac-8035-4fac-a957-fa1a5c9ea60c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:18.962464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:18.963184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:18.963472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:18.963749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:18.964528 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:18.966670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:18.968012 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING keystone.server.flask.common [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 12:26:19.026683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.sql.core [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:26:19.026683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:26:19.026683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [parameters: {'user_id': '258112f63f58431abfc53615248d47a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:26:19.026683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80389) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application conn.query(q) May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result.read() May 26 12:26:19.034855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:26:19.042217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application next(self.gen) May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application yield resource May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application next(self.gen) May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.session.rollback() May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.force_reraise() May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise self.value May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application session.commit() May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 12:26:19.043203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._prepare_impl() May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.session.flush() May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._flush(objects) May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application compat.raise_( May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application flush_context.execute() May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rec.execute(self) May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 12:26:19.044097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 12:26:19.044975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result = self._query(query) May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application conn.query(q) May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application result.read() May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 12:26:19.045934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [parameters: {'user_id': '258112f63f58431abfc53615248d47a8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:19.046861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 12:26:19.047661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 12:26:19.048588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 12:26:19.048588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 12:26:19.048588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 12:26:19.048588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 12:26:19.048588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 12:26:19.048588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:19.048588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 482/963] 10.222.0.60 () {60 vars in 1131 bytes} [Thu May 26 12:26:18 2022] POST /identity/v3/users => generated 160 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:19.049075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045573ee-9079-4696-93cd-a292aa671416 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:19.066908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:19.177087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045573ee-9079-4696-93cd-a292aa671416 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:19.217436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37d9cb-3f19-4faf-bda1-2fb76680b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:19.218295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37d9cb-3f19-4faf-bda1-2fb76680b344 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:19.218674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37d9cb-3f19-4faf-bda1-2fb76680b344 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:19.218950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37d9cb-3f19-4faf-bda1-2fb76680b344 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:19.228328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37d9cb-3f19-4faf-bda1-2fb76680b344 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:19.229848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37d9cb-3f19-4faf-bda1-2fb76680b344 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-1d37d9cb-3f19-4faf-bda1-2fb76680b344 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:19.247254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:19.249555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:19.251850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 482/964] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:26:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:19.256170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:19.276668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:19.403424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef96b8-dfb6-433b-aa33-7bb54bdeb4a2 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:19.439465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b8675-78e0-4453-91c2-53ee69d7a332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:19.440082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b8675-78e0-4453-91c2-53ee69d7a332 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:19.440361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b8675-78e0-4453-91c2-53ee69d7a332 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:19.440630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b8675-78e0-4453-91c2-53ee69d7a332 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:19.441439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b8675-78e0-4453-91c2-53ee69d7a332 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:19.441803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b8675-78e0-4453-91c2-53ee69d7a332 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:19.443745 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b8675-78e0-4453-91c2-53ee69d7a332 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:19.493203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 483/965] 10.222.0.60 () {56 vars in 1101 bytes} [Thu May 26 12:26:19 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:20.065873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb31f8d-a9bb-4c1b-ac2a-5c3646634408 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.066399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb31f8d-a9bb-4c1b-ac2a-5c3646634408 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.066547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb31f8d-a9bb-4c1b-ac2a-5c3646634408 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.068007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 483/966] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:20.074249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1fed3-2a87-4e76-be1b-d894efd198bc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.074803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1fed3-2a87-4e76-be1b-d894efd198bc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.074881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c1fed3-2a87-4e76-be1b-d894efd198bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.092556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-55c1fed3-2a87-4e76-be1b-d894efd198bc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:20.094139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-55c1fed3-2a87-4e76-be1b-d894efd198bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:20.183246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:20.192720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 484/967] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:20.218407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb31f8d-a9bb-4c1b-ac2a-5c3646634408 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:20.329514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:20.362361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb31f8d-a9bb-4c1b-ac2a-5c3646634408 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:20.384622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c8a6-bf35-4f46-90e2-c23bde999a7a None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.385011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c8a6-bf35-4f46-90e2-c23bde999a7a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.385365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825c8a6-bf35-4f46-90e2-c23bde999a7a None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.387073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 485/968] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:20.392659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae0d3-9fc9-4097-b4fc-0e854bf47250 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.392962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae0d3-9fc9-4097-b4fc-0e854bf47250 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.393488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae0d3-9fc9-4097-b4fc-0e854bf47250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.406134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6150c-9785-4595-9180-f75eeb098571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:20.406848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6150c-9785-4595-9180-f75eeb098571 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.407123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6150c-9785-4595-9180-f75eeb098571 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.407389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6150c-9785-4595-9180-f75eeb098571 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.408132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6150c-9785-4595-9180-f75eeb098571 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:20.409511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6150c-9785-4595-9180-f75eeb098571 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:20.412654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-dd5ae0d3-9fc9-4097-b4fc-0e854bf47250 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:20.414114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-dd5ae0d3-9fc9-4097-b4fc-0e854bf47250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:20.493423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 486/969] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:20.506931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb660ba9-39b2-480b-affc-3b0ace4e6a8a None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.507226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb660ba9-39b2-480b-affc-3b0ace4e6a8a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.507506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb660ba9-39b2-480b-affc-3b0ace4e6a8a None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.508871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 487/970] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:20.514093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0bf36-4c9f-432c-b5b9-054db506b858 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.514338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0bf36-4c9f-432c-b5b9-054db506b858 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.514650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0bf36-4c9f-432c-b5b9-054db506b858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.529298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 484/971] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:26:20 2022] POST /identity/v3/services => generated 242 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:20.530212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6150c-9785-4595-9180-f75eeb098571 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:20.532227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-c5c0bf36-4c9f-432c-b5b9-054db506b858 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:20.533489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c5c0bf36-4c9f-432c-b5b9-054db506b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:20.625560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 488/972] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:20.650591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0bf36-4c9f-432c-b5b9-054db506b858 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:20.673373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6150c-9785-4595-9180-f75eeb098571 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:20.715439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:20.719738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:20.720569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.720862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.721125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.721855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:20.723339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:20.726179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:20.741323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:20.742701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:20.743710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 485/973] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:20.751204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:20.769400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0bf36-4c9f-432c-b5b9-054db506b858 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:20.821600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dec3a-5dbd-4e95-91fb-621c8038baa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:20.822470 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dec3a-5dbd-4e95-91fb-621c8038baa1 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.822809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dec3a-5dbd-4e95-91fb-621c8038baa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.823087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76dec3a-5dbd-4e95-91fb-621c8038baa1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.837331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76dec3a-5dbd-4e95-91fb-621c8038baa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b76dec3a-5dbd-4e95-91fb-621c8038baa1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:20.846146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:20.847426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:20.849157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 489/974] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 26 12:26:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:20.854458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dec3a-5dbd-4e95-91fb-621c8038baa1 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:20.895474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb714a-e556-4abd-aed5-14410c6bda5b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:20.944615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:20.945292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:20.945575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:20.945919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:20.946600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:20.946914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:20.948294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:20.954275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 486/975] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:20.964827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:20.986023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76dec3a-5dbd-4e95-91fb-621c8038baa1 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.008855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:21.044746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.045885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.046376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.047021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.048318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:21.053675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.053675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.060243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:21.068406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 490/976] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 26 12:26:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:21.075640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:21.116746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e23dde-64ef-4aa3-ac83-8a974b2fa957 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.156702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.157288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.157566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.157846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.158803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:21.159203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.160621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.170558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 487/977] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:21.171939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:21.206823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de395f73-0718-4ee4-a9dc-1c9df4eaaeeb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.242604 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.243407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.243686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.243962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.256662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.260759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:21.281388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:21.282321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:21.283332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:21.283332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:21.283332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:21.283332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:21.283332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 491/978] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:21.288524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:21.298804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49119a-5e94-451e-966b-2891f7346e25 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.339016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:21.346774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:21.349486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.350336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.350648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.350927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.351742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] RBAC: Adding query filter params (interface=admin, service_id=059cf93c8c0543e19626dcb751598a85, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:21.352052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.353477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.363551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 488/979] 10.222.0.60 () {56 vars in 1249 bytes} [Thu May 26 12:26:21 2022] GET /identity/v3/endpoints?service_id=059cf93c8c0543e19626dcb751598a85&interface=admin®ion_id=RegionOne => generated 193 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:21.372750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:21.432322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa8af2-d42a-49d4-8626-fe658a46e85a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.480709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.481829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.482349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.482847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.484091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:21.484629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.487050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.495481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496aea9d-9f9b-45b0-8371-ca11a825582e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.512642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 492/980] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:21.513738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:21.535532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56829577-ad28-4dce-8d98-d7982b4f682c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.536212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56829577-ad28-4dce-8d98-d7982b4f682c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.536496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56829577-ad28-4dce-8d98-d7982b4f682c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.536775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56829577-ad28-4dce-8d98-d7982b4f682c None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.537633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56829577-ad28-4dce-8d98-d7982b4f682c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.539062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56829577-ad28-4dce-8d98-d7982b4f682c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.546004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 489/981] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:26:21 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:26:21.633189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:21.644209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f217924-ec15-4c8b-a7bc-68c92736d23e None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.684301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.685144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.685431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.685824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.695815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.697314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:21.714375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:21.715546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:21.716694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 493/982] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:26:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:21.722653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56829577-ad28-4dce-8d98-d7982b4f682c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:21.803226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:21.857871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56829577-ad28-4dce-8d98-d7982b4f682c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:21.895666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499221c4-6021-4491-a353-de188560d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:21.896435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499221c4-6021-4491-a353-de188560d84a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:21.897414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499221c4-6021-4491-a353-de188560d84a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:21.897720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499221c4-6021-4491-a353-de188560d84a None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:21.898602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499221c4-6021-4491-a353-de188560d84a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:21.898918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499221c4-6021-4491-a353-de188560d84a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:21.900361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499221c4-6021-4491-a353-de188560d84a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:21.920763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 490/983] 10.222.0.60 () {56 vars in 1149 bytes} [Thu May 26 12:26:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:21.926446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:22.052840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af4389-6484-456a-8f76-99aa3aa454d7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:22.092642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147a033-fe7a-477a-a4f0-ae88f0dca126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:22.093289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a033-fe7a-477a-a4f0-ae88f0dca126 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:22.093576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a033-fe7a-477a-a4f0-ae88f0dca126 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:22.093849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147a033-fe7a-477a-a4f0-ae88f0dca126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:22.114362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:22.172470 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147a033-fe7a-477a-a4f0-ae88f0dca126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:22.173925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147a033-fe7a-477a-a4f0-ae88f0dca126 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:22.304705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 494/984] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:21 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:22.306492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499221c4-6021-4491-a353-de188560d84a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:22.421410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499221c4-6021-4491-a353-de188560d84a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:22.436352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:22.460970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:22.461780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:22.462064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:22.462340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:22.472912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:22.474401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:22.493496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:22.494484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:22.495428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:22.495428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:22.495428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:22.495428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:22.498648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 491/985] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:22.500748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147a033-fe7a-477a-a4f0-ae88f0dca126 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:22.556627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:22.622514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147a033-fe7a-477a-a4f0-ae88f0dca126 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:22.681335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7099c03-840c-4364-a98e-441f1d58e159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:22.682440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7099c03-840c-4364-a98e-441f1d58e159 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:22.682951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7099c03-840c-4364-a98e-441f1d58e159 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:22.683410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7099c03-840c-4364-a98e-441f1d58e159 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:22.684699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7099c03-840c-4364-a98e-441f1d58e159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:22.685255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7099c03-840c-4364-a98e-441f1d58e159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:22.687699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7099c03-840c-4364-a98e-441f1d58e159 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:22.710661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 495/986] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:22.719533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:22.865418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ccdf8-d789-4805-a000-35e98f8b805b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:22.929558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae670b0-ebb3-41ae-8384-d0df205b323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:22.930963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae670b0-ebb3-41ae-8384-d0df205b323d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:22.931461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae670b0-ebb3-41ae-8384-d0df205b323d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:22.931957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae670b0-ebb3-41ae-8384-d0df205b323d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:22.945245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae670b0-ebb3-41ae-8384-d0df205b323d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:22.947924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae670b0-ebb3-41ae-8384-d0df205b323d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3ae670b0-ebb3-41ae-8384-d0df205b323d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:22.965355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:22.966443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:22.967699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:22.967699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:22.967699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:22.967699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:22.967699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:22.967699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:22.967699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:22.967699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:22.968417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1cdaa-9896-4f84-b7a9-807078570795 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:22.968417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1cdaa-9896-4f84-b7a9-807078570795 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:22.968417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1cdaa-9896-4f84-b7a9-807078570795 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:22.973254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 496/987] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:22.973466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 492/988] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:22.973876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1cdaa-9896-4f84-b7a9-807078570795 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:22.979338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981130f-9a50-4b11-99c3-2611c19add85 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:22.979673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981130f-9a50-4b11-99c3-2611c19add85 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:22.979916 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f981130f-9a50-4b11-99c3-2611c19add85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.004495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f981130f-9a50-4b11-99c3-2611c19add85 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:23.006865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f981130f-9a50-4b11-99c3-2611c19add85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:23.045896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:23.124543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 493/989] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:23.128023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1cdaa-9896-4f84-b7a9-807078570795 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:23.141471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:23.148543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981130f-9a50-4b11-99c3-2611c19add85 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:23.170948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:23.171628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.171912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.172191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.173539 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:23.174587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:23.177046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:23.198432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 497/990] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:23.199732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:23.272109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f981130f-9a50-4b11-99c3-2611c19add85 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:23.317209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:23.319439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.319721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.320004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.320669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:23.322136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:23.336622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:23.337840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:23.339739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:23.340492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d693a-bcd6-41e9-8fc6-4896c4cfb379 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:23.340579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 494/991] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:23.346831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:23.380548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:23.395672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:23.396741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.397196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.397716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.399606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] RBAC: Adding query filter params (role.id=6f1199c39ce64672bbee1aac2d5311c6, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=709a912079c747838254b83f06568cca) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:23.400144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:23.402936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:23.426568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 498/992] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:23 2022] GET /identity/v3/role_assignments?user.id=709a912079c747838254b83f06568cca&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=6f1199c39ce64672bbee1aac2d5311c6 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:23.512599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ca5a72-da50-4a4c-9d7e-23388bc36d1a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:23.571494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:23.572552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.572980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.573424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.574730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:23.575229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:23.577646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:23.591800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 495/993] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:26:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:23.592726 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:23.636671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:23.760459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaaa6b-098f-49b0-bdcc-e5c161943cef None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:23.802351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d132fb-2f68-4d7f-a26d-df3a5145af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:23.804098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d132fb-2f68-4d7f-a26d-df3a5145af84 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.804382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d132fb-2f68-4d7f-a26d-df3a5145af84 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.804657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d132fb-2f68-4d7f-a26d-df3a5145af84 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.805374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d132fb-2f68-4d7f-a26d-df3a5145af84 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:23.805680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d132fb-2f68-4d7f-a26d-df3a5145af84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:23.807181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d132fb-2f68-4d7f-a26d-df3a5145af84 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:23.812933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 499/994] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:26:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:23.820391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:23.914983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f18a9-5bf6-4aaf-9c76-885a07cfa2fb None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.915176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f18a9-5bf6-4aaf-9c76-885a07cfa2fb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.916052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f18a9-5bf6-4aaf-9c76-885a07cfa2fb None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.916175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:23.917099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 500/995] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:23.922395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3542c0-0299-4398-82a3-759cce760325 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.922713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3542c0-0299-4398-82a3-759cce760325 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.922986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3542c0-0299-4398-82a3-759cce760325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.937354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97380474-0a58-4fd4-bf56-fd5bd0788e84 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:23.942848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-db3542c0-0299-4398-82a3-759cce760325 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:23.944937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-db3542c0-0299-4398-82a3-759cce760325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:23.978935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:23.979838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:23.980067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:23.980362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:23.981147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] RBAC: Adding query filter params (interface=public, service_id=3d9c982d96f7455ba879da209dfd59a2, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:23.981456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:23.982875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:23.995896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 496/996] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 26 12:26:23 2022] GET /identity/v3/endpoints?service_id=3d9c982d96f7455ba879da209dfd59a2&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:23.997098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:24.021579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 501/997] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:24.046491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3542c0-0299-4398-82a3-759cce760325 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:24.087703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:24.170441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf8b5e-4fde-442e-9fae-373980ddba4f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:24.188734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3542c0-0299-4398-82a3-759cce760325 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:24.211822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f044-237f-41aa-8cd2-c4565d3979c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:24.212499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f044-237f-41aa-8cd2-c4565d3979c9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:24.212819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f044-237f-41aa-8cd2-c4565d3979c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:24.213056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d178f044-237f-41aa-8cd2-c4565d3979c9 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:24.213789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f044-237f-41aa-8cd2-c4565d3979c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:24.215143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d178f044-237f-41aa-8cd2-c4565d3979c9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:24.230556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 497/998] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:26:23 2022] GET /identity/v3/services => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:26:24.242182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:24.243248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:24.243605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:24.243953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:24.244733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:24.246314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:24.263851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:24.264971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:24.271407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 502/999] 10.222.0.60 () {56 vars in 1126 bytes} [Thu May 26 12:26:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:24.274097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f044-237f-41aa-8cd2-c4565d3979c9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:24.288853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:24.402454 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d178f044-237f-41aa-8cd2-c4565d3979c9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:24.444437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:24.445040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:24.445322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:24.445598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:24.446311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:24.446687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:24.448070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:24.453631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 498/1000] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:24.462827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:24.562771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:24.572206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5021560c-753f-49a2-864c-8ea26b5287e3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:24.610203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551b8c6-c776-4c73-92ee-3c929229fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:24.611011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551b8c6-c776-4c73-92ee-3c929229fbdd None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:24.611288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551b8c6-c776-4c73-92ee-3c929229fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:24.611561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551b8c6-c776-4c73-92ee-3c929229fbdd None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:24.612317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551b8c6-c776-4c73-92ee-3c929229fbdd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:24.612625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551b8c6-c776-4c73-92ee-3c929229fbdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:24.613977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551b8c6-c776-4c73-92ee-3c929229fbdd None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:24.624722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 503/1001] 10.222.0.60 () {56 vars in 1122 bytes} [Thu May 26 12:26:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:24.626035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:24.705559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:24.737252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68123987-3b3a-41c9-8c46-9b2a4594c118 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:24.783770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c07516-d837-4039-a4f8-3125e8ad9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:24.784439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c07516-d837-4039-a4f8-3125e8ad9f88 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:24.784716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c07516-d837-4039-a4f8-3125e8ad9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:24.784987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c07516-d837-4039-a4f8-3125e8ad9f88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:24.785757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c07516-d837-4039-a4f8-3125e8ad9f88 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:24.787311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c07516-d837-4039-a4f8-3125e8ad9f88 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:24.942791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 499/1002] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:26:24 2022] POST /identity/v3/endpoints => generated 325 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:25.907870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae262-9118-4334-8628-d076de918861 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:25.908403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae262-9118-4334-8628-d076de918861 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:25.908484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ae262-9118-4334-8628-d076de918861 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:25.910570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 504/1003] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:25.916001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba6101-2ac3-4802-ad51-8ad91e6f3348 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:25.916514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba6101-2ac3-4802-ad51-8ad91e6f3348 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:25.916600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba6101-2ac3-4802-ad51-8ad91e6f3348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:25.934449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ffba6101-2ac3-4802-ad51-8ad91e6f3348 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:25.935722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ffba6101-2ac3-4802-ad51-8ad91e6f3348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:26.014926 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 500/1004] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:25 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:26.038447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae262-9118-4334-8628-d076de918861 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:26.153337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ae262-9118-4334-8628-d076de918861 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:26.188857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:26.189567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.189945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.190225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.190914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:26.192393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:26.205101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:26.206170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:26.207062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:26.208535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 505/1005] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 26 12:26:26 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:26.212990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba6101-2ac3-4802-ad51-8ad91e6f3348 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:26.283945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:26.328539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba6101-2ac3-4802-ad51-8ad91e6f3348 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:26.369150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fba03ea-0d79-46bf-a90f-5e4f3f328764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:26.369514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba03ea-0d79-46bf-a90f-5e4f3f328764 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.369804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba03ea-0d79-46bf-a90f-5e4f3f328764 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.370122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba03ea-0d79-46bf-a90f-5e4f3f328764 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.371019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba03ea-0d79-46bf-a90f-5e4f3f328764 None admin] RBAC: Adding query filter params (name=image) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:26.371331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba03ea-0d79-46bf-a90f-5e4f3f328764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:26.372777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fba03ea-0d79-46bf-a90f-5e4f3f328764 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:26.378969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 501/1006] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:26.385625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:26.411172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:26.511971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688fa5e-a631-49fc-ad8a-22baf8c9b3a4 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:26.547008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853c36e-8e7e-450e-b4d5-5d8373675b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:26.547698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853c36e-8e7e-450e-b4d5-5d8373675b79 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.547997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853c36e-8e7e-450e-b4d5-5d8373675b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.548238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853c36e-8e7e-450e-b4d5-5d8373675b79 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.548953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853c36e-8e7e-450e-b4d5-5d8373675b79 None admin] RBAC: Adding query filter params (type=image) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:26.549258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853c36e-8e7e-450e-b4d5-5d8373675b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:26.550642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853c36e-8e7e-450e-b4d5-5d8373675b79 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:26.556567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 506/1007] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:26 2022] GET /identity/v3/services?type=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:26.571829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da711b0e-5fd4-4649-9a47-1f9e8621797c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.572151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da711b0e-5fd4-4649-9a47-1f9e8621797c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.572397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da711b0e-5fd4-4649-9a47-1f9e8621797c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.574597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 502/1008] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:26.580293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7142e-27b6-44a4-a0a2-fdcf044e95e0 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.580653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7142e-27b6-44a4-a0a2-fdcf044e95e0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.580846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7142e-27b6-44a4-a0a2-fdcf044e95e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.600641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9ac7142e-27b6-44a4-a0a2-fdcf044e95e0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:26.602061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9ac7142e-27b6-44a4-a0a2-fdcf044e95e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:26.698586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 507/1009] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:26 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:26.720247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da711b0e-5fd4-4649-9a47-1f9e8621797c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:26.844202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da711b0e-5fd4-4649-9a47-1f9e8621797c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:26.870862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:26.888043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:26.888847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:26.889129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:26.889404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:26.890064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:26.891647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:26.905907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:26.908211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 12:26:26.909982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:26.914002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 503/1010] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:26.918692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7142e-27b6-44a4-a0a2-fdcf044e95e0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:26.932530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:27.040544 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7142e-27b6-44a4-a0a2-fdcf044e95e0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:27.080659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3a614-7cb0-40cd-a96c-97017743e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:27.081330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3a614-7cb0-40cd-a96c-97017743e82c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:27.081619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3a614-7cb0-40cd-a96c-97017743e82c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:27.081949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3a614-7cb0-40cd-a96c-97017743e82c None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:27.082617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3a614-7cb0-40cd-a96c-97017743e82c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:27.082924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3a614-7cb0-40cd-a96c-97017743e82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:27.085011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3a614-7cb0-40cd-a96c-97017743e82c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:27.096078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 508/1011] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:26:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:27.097443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:27.256735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557913c-852d-4950-ba2a-b80f5cd47cf4 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:27.317413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:27.318107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:27.318377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:27.318783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:27.319402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:27.319827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:27.321865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:27.326676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 504/1012] 10.222.0.60 () {56 vars in 1112 bytes} [Thu May 26 12:26:27 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:27.329454 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb667-5fcf-4804-83bd-a26f9bfa5be5 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:27.329734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb667-5fcf-4804-83bd-a26f9bfa5be5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:27.330010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caecb667-5fcf-4804-83bd-a26f9bfa5be5 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:27.331427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 509/1013] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:27.332361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:27.336944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf007e1-f2fc-4834-bab9-c5b7323afccb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:27.337229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf007e1-f2fc-4834-bab9-c5b7323afccb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:27.337508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf007e1-f2fc-4834-bab9-c5b7323afccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:27.357087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-aaf007e1-f2fc-4834-bab9-c5b7323afccb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:27.358172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-aaf007e1-f2fc-4834-bab9-c5b7323afccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:27.396074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:27.431784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 510/1014] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:27.451187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286f29b-3529-4cae-9092-0c50e955ca96 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:27.455314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf007e1-f2fc-4834-bab9-c5b7323afccb None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:27.468100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:27.489253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe644-1b22-4ce6-9f1b-928150132a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:27.490024 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe644-1b22-4ce6-9f1b-928150132a34 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:27.490775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe644-1b22-4ce6-9f1b-928150132a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:27.491049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffe644-1b22-4ce6-9f1b-928150132a34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:27.491894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffe644-1b22-4ce6-9f1b-928150132a34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:27.493244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffe644-1b22-4ce6-9f1b-928150132a34 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:27.594238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf007e1-f2fc-4834-bab9-c5b7323afccb None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:27.610650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 505/1015] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:26:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:26:27.658167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777221ea-b94a-4061-870e-d1ba1e764339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:27.659117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777221ea-b94a-4061-870e-d1ba1e764339 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:27.659400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777221ea-b94a-4061-870e-d1ba1e764339 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:27.659674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777221ea-b94a-4061-870e-d1ba1e764339 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:27.660940 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777221ea-b94a-4061-870e-d1ba1e764339 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:27.663820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777221ea-b94a-4061-870e-d1ba1e764339 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:27.665834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 511/1016] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:27.672122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe644-1b22-4ce6-9f1b-928150132a34 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:27.811580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffe644-1b22-4ce6-9f1b-928150132a34 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:27.823067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:27.854029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a171a2c0-c6ed-4b0a-a3b7-ad9e8eca159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:27.854745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a2c0-c6ed-4b0a-a3b7-ad9e8eca159e None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:27.855029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a2c0-c6ed-4b0a-a3b7-ad9e8eca159e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:27.855300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a171a2c0-c6ed-4b0a-a3b7-ad9e8eca159e None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:27.856036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171a2c0-c6ed-4b0a-a3b7-ad9e8eca159e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:27.857457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a171a2c0-c6ed-4b0a-a3b7-ad9e8eca159e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:28.023297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 506/1017] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:26:27 2022] POST /identity/v3/projects => generated 311 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:26:28.956376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422f9f-cf1b-4c69-affb-1267838a3004 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:28.957201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422f9f-cf1b-4c69-affb-1267838a3004 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:28.957201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2422f9f-cf1b-4c69-affb-1267838a3004 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:28.958638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 512/1018] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:28.965584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866050-b4c4-4fc1-81a4-e290c22be01e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:28.966344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866050-b4c4-4fc1-81a4-e290c22be01e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:28.966752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b866050-b4c4-4fc1-81a4-e290c22be01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:28.992532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4b866050-b4c4-4fc1-81a4-e290c22be01e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:28.993762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4b866050-b4c4-4fc1-81a4-e290c22be01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:29.090723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 507/1019] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:28 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:29.113045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2422f9f-cf1b-4c69-affb-1267838a3004 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:29.191406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:29.227518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2422f9f-cf1b-4c69-affb-1267838a3004 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:29.282184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cd8fa-bbc2-498e-aafe-f1d4d114ff03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:29.282913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd8fa-bbc2-498e-aafe-f1d4d114ff03 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:29.283192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd8fa-bbc2-498e-aafe-f1d4d114ff03 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:29.283504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cd8fa-bbc2-498e-aafe-f1d4d114ff03 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:29.284246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cd8fa-bbc2-498e-aafe-f1d4d114ff03 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:29.285702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cd8fa-bbc2-498e-aafe-f1d4d114ff03 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:29.421057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 513/1020] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:26:29 2022] POST /identity/v3/services => generated 242 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:30.170074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3a648-6b08-47fa-95b1-1db73d6f3029 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.170725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3a648-6b08-47fa-95b1-1db73d6f3029 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.170725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f3a648-6b08-47fa-95b1-1db73d6f3029 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.172246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 508/1021] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:30.177948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930451-6daf-4570-b425-9892036b9dbb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.178709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930451-6daf-4570-b425-9892036b9dbb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.178709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57930451-6daf-4570-b425-9892036b9dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.200320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-57930451-6daf-4570-b425-9892036b9dbb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:30.201574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-57930451-6daf-4570-b425-9892036b9dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:30.311343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 514/1022] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:30.337376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3a648-6b08-47fa-95b1-1db73d6f3029 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.402173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaa67f-c202-493f-9ca3-8ca066eb5a5d None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.402501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaa67f-c202-493f-9ca3-8ca066eb5a5d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.402780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaa67f-c202-493f-9ca3-8ca066eb5a5d None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.404174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 515/1023] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:30.409814 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ec7f3-68cc-4ed9-b77c-fd3e2a3cbd7b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.410101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ec7f3-68cc-4ed9-b77c-fd3e2a3cbd7b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.410351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ec7f3-68cc-4ed9-b77c-fd3e2a3cbd7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.434546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-923ec7f3-68cc-4ed9-b77c-fd3e2a3cbd7b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:30.435781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-923ec7f3-68cc-4ed9-b77c-fd3e2a3cbd7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:30.464890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:30.477375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f3a648-6b08-47fa-95b1-1db73d6f3029 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.502036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:30.520708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 516/1024] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:30.526300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6737ece-74a7-42ef-a71a-c983bc371b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.529724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6737ece-74a7-42ef-a71a-c983bc371b0a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.529724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6737ece-74a7-42ef-a71a-c983bc371b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.529724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6737ece-74a7-42ef-a71a-c983bc371b0a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.543284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6737ece-74a7-42ef-a71a-c983bc371b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:30.550817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ec7f3-68cc-4ed9-b77c-fd3e2a3cbd7b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b6737ece-74a7-42ef-a71a-c983bc371b0a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:30.551675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:30.552702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:30.559613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 509/1025] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 26 12:26:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:30.560347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6737ece-74a7-42ef-a71a-c983bc371b0a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.688994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ec7f3-68cc-4ed9-b77c-fd3e2a3cbd7b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.727011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6737ece-74a7-42ef-a71a-c983bc371b0a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.746235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb85a-e53d-4b24-a86e-38a38fd55b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.747155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb85a-e53d-4b24-a86e-38a38fd55b60 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.747482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb85a-e53d-4b24-a86e-38a38fd55b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.749686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cb85a-e53d-4b24-a86e-38a38fd55b60 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.749686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cb85a-e53d-4b24-a86e-38a38fd55b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:30.750493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cb85a-e53d-4b24-a86e-38a38fd55b60 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:30.752336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 517/1026] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:30.758638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb85a-e53d-4b24-a86e-38a38fd55b60 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.778989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.779967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.780248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.780524 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.781289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:30.781745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:30.783478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:30.794959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 510/1027] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 26 12:26:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:30.802664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:30.820991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:30.842590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:30.923042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109a6a3-82ae-43d6-b4d0-ff5e47a73459 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.924882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cb85a-e53d-4b24-a86e-38a38fd55b60 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:30.961776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.962494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.962799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.963074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.975990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:30.977510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:30.979842 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964d20-6f67-4670-9313-efbc94e1b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:30.980529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964d20-6f67-4670-9313-efbc94e1b3af None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:30.980808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964d20-6f67-4670-9313-efbc94e1b3af None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:30.981078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09964d20-6f67-4670-9313-efbc94e1b3af None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:30.981788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09964d20-6f67-4670-9313-efbc94e1b3af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:30.983233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09964d20-6f67-4670-9313-efbc94e1b3af None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:31.004703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:31.005918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:31.011373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:31.011373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:31.011373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:31.011373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:31.011373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 511/1028] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:31.014222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:31.100445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 518/1029] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:26:30 2022] POST /identity/v3/users => generated 285 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:26:31.112909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:31.156380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8027f-c0bb-40a3-a75b-fe989967fba3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:31.203524 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:31.204210 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:31.204488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:31.204762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:31.205510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:31.205816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:31.207269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:31.222823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 512/1030] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:31.229131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964d20-6f67-4670-9313-efbc94e1b3af None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:31.376120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09964d20-6f67-4670-9313-efbc94e1b3af None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:31.392608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:31.416421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:31.417238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:31.417520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:31.417796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:31.426660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:31.429503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:31.446155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:31.447557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:31.449164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 519/1031] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:26:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:31.454661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:31.569064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec916f-9912-4c7b-ad1c-cfc04c045620 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:31.600349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:31.612554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ea4c9-d98e-490f-a27e-de10a143df84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:31.613244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ea4c9-d98e-490f-a27e-de10a143df84 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:31.613528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ea4c9-d98e-490f-a27e-de10a143df84 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:31.619137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ea4c9-d98e-490f-a27e-de10a143df84 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:31.619137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ea4c9-d98e-490f-a27e-de10a143df84 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:31.619137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ea4c9-d98e-490f-a27e-de10a143df84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:31.619137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ea4c9-d98e-490f-a27e-de10a143df84 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:31.643360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 513/1032] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:26:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:31.644589 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:31.755576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973dc8b-2242-47ec-9b2f-490f8a8627f1 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:31.793708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1bcc0-1e76-485b-94e0-8dcc7087d2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:31.794359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1bcc0-1e76-485b-94e0-8dcc7087d2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:31.794702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1bcc0-1e76-485b-94e0-8dcc7087d2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:31.794923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f1bcc0-1e76-485b-94e0-8dcc7087d2d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:31.840390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:31.868150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1bcc0-1e76-485b-94e0-8dcc7087d2d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:31.869599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f1bcc0-1e76-485b-94e0-8dcc7087d2d7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:31.944935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91480150-2fd1-4afa-bbcf-4fedf8cca286 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:31.945244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91480150-2fd1-4afa-bbcf-4fedf8cca286 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:31.945479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91480150-2fd1-4afa-bbcf-4fedf8cca286 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:31.947441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 514/1033] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:31.952335 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3967-246f-418c-82c6-436a90c4b91b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:31.952623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3967-246f-418c-82c6-436a90c4b91b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:31.952899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d3967-246f-418c-82c6-436a90c4b91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:31.970102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0e6d3967-246f-418c-82c6-436a90c4b91b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:31.971329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0e6d3967-246f-418c-82c6-436a90c4b91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:31.981344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 520/1034] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:31 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:26:31.986872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1bcc0-1e76-485b-94e0-8dcc7087d2d7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.058688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 515/1035] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:32.063691 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:32.075631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d3967-246f-418c-82c6-436a90c4b91b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.105046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f1bcc0-1e76-485b-94e0-8dcc7087d2d7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.143261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.144985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.145752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.146791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.163664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.165161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:32.188368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:32.189365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:32.190291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:32.190291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:32.190291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:32.190291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:32.190291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 521/1036] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:32.196141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.201857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d3967-246f-418c-82c6-436a90c4b91b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.218684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:32.243616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.244427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.244708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.244984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] PATH_INFO: `/v3/services/image` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.245639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.247504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:32.260285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:32.261473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:32.262305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 516/1037] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:32.268651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.329279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a413f94-c547-4bd1-bbdb-822f042126b3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.372281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:32.385051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.386053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.386488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.386947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.387670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:32.388047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.389459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.404402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 522/1038] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:32.409698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.427569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1bb6e-3749-4015-9216-712fde4f177a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.477521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.478518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.479084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.479440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.480749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] RBAC: Adding query filter params (name=image) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:32.481209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.483369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.491234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 517/1039] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:32.496923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.523610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9240f6d0-e081-417d-ab85-66643db6a376 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.545074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:32.561350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.562182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.562557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.562823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.570495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.571977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:32.587390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:32.589230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:32.590990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 523/1040] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:32.595820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.622013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c71bb-6cd2-4bc8-afd4-cba770fbe81d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.660467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:32.664566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.665323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.665607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.665881 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.666620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] RBAC: Adding query filter params (type=image) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:32.666925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.668425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.673897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 518/1041] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:32.680707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.740504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e52a9-8df1-45a9-a4ed-d52394d32277 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.780382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.781159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.781509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.781856 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.782750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:32.783146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.784664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.796436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef469940-6ecb-4020-9ab8-313848e71d4c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.799067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 524/1042] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:32.800538 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:32.806712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.845506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.846329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.846648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.846921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.847775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] RBAC: Adding query filter params (interface=public, service_id=1069364c4ebb493390cd0e82c8800e91, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:32.848088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.850070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.859623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 519/1043] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/endpoints?service_id=1069364c4ebb493390cd0e82c8800e91&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:32.865267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:32.940067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d37ce-35a5-4fea-9426-9b6ecd88551d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.943944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:32.979286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac26c3-81c2-4fcd-af8b-6dcece68b31e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:32.980858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc42e6-0838-4e96-98bc-31f8d312cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:32.981585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc42e6-0838-4e96-98bc-31f8d312cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:32.981871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc42e6-0838-4e96-98bc-31f8d312cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:32.982140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc42e6-0838-4e96-98bc-31f8d312cfa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:32.983000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc42e6-0838-4e96-98bc-31f8d312cfa4 None admin] RBAC: Adding query filter params (role.id=6f1199c39ce64672bbee1aac2d5311c6, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=5643e9f777c94d06a2f5c687dd8919b6) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:32.983307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc42e6-0838-4e96-98bc-31f8d312cfa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:32.984718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc42e6-0838-4e96-98bc-31f8d312cfa4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:32.991201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 525/1044] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/role_assignments?user.id=5643e9f777c94d06a2f5c687dd8919b6&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=6f1199c39ce64672bbee1aac2d5311c6 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:33.029633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2086c99-3528-4f66-af90-f2eb3a162d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:33.030634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2086c99-3528-4f66-af90-f2eb3a162d14 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.031267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2086c99-3528-4f66-af90-f2eb3a162d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.031701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2086c99-3528-4f66-af90-f2eb3a162d14 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.032542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2086c99-3528-4f66-af90-f2eb3a162d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:33.034050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2086c99-3528-4f66-af90-f2eb3a162d14 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:33.050635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 520/1045] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:26:32 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:26:33.539072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427ce20-2790-4f47-94fb-88b38d1ec763 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.539072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427ce20-2790-4f47-94fb-88b38d1ec763 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.539658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7427ce20-2790-4f47-94fb-88b38d1ec763 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.540979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 526/1046] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:33.546727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47581b-5056-4e1d-89a9-16fe8092b5ae None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.547238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47581b-5056-4e1d-89a9-16fe8092b5ae None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.547315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47581b-5056-4e1d-89a9-16fe8092b5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.576835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9c47581b-5056-4e1d-89a9-16fe8092b5ae None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:33.578042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9c47581b-5056-4e1d-89a9-16fe8092b5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:33.609788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:33.661748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 521/1047] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:33.685466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427ce20-2790-4f47-94fb-88b38d1ec763 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:33.802299 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7427ce20-2790-4f47-94fb-88b38d1ec763 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:33.854127 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2948-6ed6-444c-8587-f2760cdf7b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:33.855375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2948-6ed6-444c-8587-f2760cdf7b79 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:33.855796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2948-6ed6-444c-8587-f2760cdf7b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:33.856201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae2948-6ed6-444c-8587-f2760cdf7b79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:33.874007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae2948-6ed6-444c-8587-f2760cdf7b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-39ae2948-6ed6-444c-8587-f2760cdf7b79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:33.888282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:33.889279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:33.896034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 527/1048] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:26:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:33.896871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47581b-5056-4e1d-89a9-16fe8092b5ae None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:34.001711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47581b-5056-4e1d-89a9-16fe8092b5ae None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:34.042029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:34.042629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.042868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.043145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:34.043882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:34.044189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:34.045559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:34.056910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 522/1049] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:26:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:34.062609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2948-6ed6-444c-8587-f2760cdf7b79 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:34.095384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:34.190939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae2948-6ed6-444c-8587-f2760cdf7b79 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:34.230137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c8b2-908c-4263-9090-18f651ca088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:34.231054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c8b2-908c-4263-9090-18f651ca088d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.231324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c8b2-908c-4263-9090-18f651ca088d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.231590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1c8b2-908c-4263-9090-18f651ca088d None admin] PATH_INFO: `/v3/users/37c73670751444e4887ef41579168ebe` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:34.251046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1c8b2-908c-4263-9090-18f651ca088d None admin] RBAC: Authorizing `identity:get_user(user_id=37c73670751444e4887ef41579168ebe)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:34.252511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1c8b2-908c-4263-9090-18f651ca088d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:34.254614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 528/1050] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:34 2022] GET /identity/v3/users/37c73670751444e4887ef41579168ebe => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:34.263119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:34.301528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:34.387613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f0286b-6385-45ee-a10d-7e93b4edfd4f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:34.448025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382e5e4-1dc1-4799-b446-88ca14e31286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:34.448694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382e5e4-1dc1-4799-b446-88ca14e31286 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.448966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382e5e4-1dc1-4799-b446-88ca14e31286 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.449419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4382e5e4-1dc1-4799-b446-88ca14e31286 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:34.542884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382e5e4-1dc1-4799-b446-88ca14e31286 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:34.544337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4382e5e4-1dc1-4799-b446-88ca14e31286 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:34.578516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:34.682174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 523/1051] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:26:34.683837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c8b2-908c-4263-9090-18f651ca088d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:34.789366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:34.813407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1c8b2-908c-4263-9090-18f651ca088d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:34.855053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bbd2f3-d5cd-4850-a95d-beae59769ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:34.855922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbd2f3-d5cd-4850-a95d-beae59769ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:34.856205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbd2f3-d5cd-4850-a95d-beae59769ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:34.856471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bbd2f3-d5cd-4850-a95d-beae59769ba0 None admin] PATH_INFO: `/v3/projects/0fa963faf1774b0ea76a53be5b0f596e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:34.857675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbd2f3-d5cd-4850-a95d-beae59769ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa963faf1774b0ea76a53be5b0f596e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:34.859157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bbd2f3-d5cd-4850-a95d-beae59769ba0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:34.866573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 529/1052] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:26:34 2022] GET /identity/v3/projects/0fa963faf1774b0ea76a53be5b0f596e => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:34.867639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382e5e4-1dc1-4799-b446-88ca14e31286 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:34.983263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4382e5e4-1dc1-4799-b446-88ca14e31286 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:35.009869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:35.026550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac19c71-c008-4255-90c4-331ea87f402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:35.027965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac19c71-c008-4255-90c4-331ea87f402c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.028873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac19c71-c008-4255-90c4-331ea87f402c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.029435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac19c71-c008-4255-90c4-331ea87f402c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.030585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac19c71-c008-4255-90c4-331ea87f402c None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=0fa963faf1774b0ea76a53be5b0f596e, user.id=37c73670751444e4887ef41579168ebe) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:35.031081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac19c71-c008-4255-90c4-331ea87f402c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:35.032736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac19c71-c008-4255-90c4-331ea87f402c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:35.040255 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 524/1053] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:34 2022] GET /identity/v3/role_assignments?user.id=37c73670751444e4887ef41579168ebe&scope.project.id=0fa963faf1774b0ea76a53be5b0f596e&role.id=07de3e1931ca4d799df8510428e181aa => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:35.337955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b784d5-51d3-4662-aeca-767fed9fdae0 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.338337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b784d5-51d3-4662-aeca-767fed9fdae0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.338500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b784d5-51d3-4662-aeca-767fed9fdae0 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.340224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 530/1054] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:35.345902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748022a4-0884-471a-9746-cbfe11a93a77 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.346175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748022a4-0884-471a-9746-cbfe11a93a77 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.346453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748022a4-0884-471a-9746-cbfe11a93a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.365105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-748022a4-0884-471a-9746-cbfe11a93a77 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:35.366628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-748022a4-0884-471a-9746-cbfe11a93a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:35.440663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526a64-22c5-473a-a86e-4428a475cf6c None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.440958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526a64-22c5-473a-a86e-4428a475cf6c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.441230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526a64-22c5-473a-a86e-4428a475cf6c None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.442761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 531/1055] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:26:35.443609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 525/1056] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:35.449000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699f55e-5cce-4288-9845-835a294d2461 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.449283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699f55e-5cce-4288-9845-835a294d2461 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.449553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699f55e-5cce-4288-9845-835a294d2461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.466790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7699f55e-5cce-4288-9845-835a294d2461 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:35.466974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748022a4-0884-471a-9746-cbfe11a93a77 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:35.467974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7699f55e-5cce-4288-9845-835a294d2461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:35.563906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 532/1057] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:35 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:35.590653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699f55e-5cce-4288-9845-835a294d2461 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:35.624981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748022a4-0884-471a-9746-cbfe11a93a77 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:35.645964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:35.666456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe9c2-54eb-45be-ab79-9eb0e2d20602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:35.667316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe9c2-54eb-45be-ab79-9eb0e2d20602 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.667594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe9c2-54eb-45be-ab79-9eb0e2d20602 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.667865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe9c2-54eb-45be-ab79-9eb0e2d20602 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.679483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfe9c2-54eb-45be-ab79-9eb0e2d20602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-98bfe9c2-54eb-45be-ab79-9eb0e2d20602 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:35.687876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:35.689053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:35.690493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 526/1058] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 26 12:26:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:35.695569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe9c2-54eb-45be-ab79-9eb0e2d20602 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:35.702262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:35.720253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699f55e-5cce-4288-9845-835a294d2461 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:35.761104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:35.762371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.762882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.763366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] PATH_INFO: `/v3/services/image` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.764211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:35.765789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:35.780195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:35.781376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:35.782289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 533/1059] 10.222.0.60 () {56 vars in 1105 bytes} [Thu May 26 12:26:35 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:35.788619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:35.811556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe9c2-54eb-45be-ab79-9eb0e2d20602 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:35.848665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:35.849872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.850254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.850481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.851295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:35.851587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:35.852959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:35.867339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 527/1060] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 26 12:26:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:35.868417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:35.908436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68029dd2-c1ca-4979-89ca-a64a3439111f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:35.927801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:35.949901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:35.950721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:35.950905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:35.951140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:35.951840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] RBAC: Adding query filter params (name=image) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:35.952147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:35.953492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:35.964310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 534/1061] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:35.965715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:35.982150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:35.992603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de4ab9-02e0-43bb-a22f-8db408f0d11d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.032834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.033924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.034260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.034568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.046091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.047528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:36.066423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:36.067412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:36.069121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:36.069121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:36.069121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:36.069121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:36.069121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 528/1062] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:36.073416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.076841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befde09-07ba-445f-a6d4-1277fcdf3e7c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.118149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.119118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.119402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.119669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.120737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] RBAC: Adding query filter params (type=image) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:36.121025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.122403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.133635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 535/1063] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:36.135630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.176988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.190978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03725adf-3f2d-4540-adb6-a6d60aee3749 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.234168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.234420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.234891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.235173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.235452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.236268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:36.236568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.237985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.251788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 529/1064] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:36.258889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.261477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55054874-f7e8-44bb-8bef-ada4cb069702 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.305050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e8296-7d22-4cba-86e8-f4e8c12b0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.305271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8296-7d22-4cba-86e8-f4e8c12b0e86 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.305520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8296-7d22-4cba-86e8-f4e8c12b0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.305796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e8296-7d22-4cba-86e8-f4e8c12b0e86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.306545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e8296-7d22-4cba-86e8-f4e8c12b0e86 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.308045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e8296-7d22-4cba-86e8-f4e8c12b0e86 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.375254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474c26b-9303-4812-89ba-35e44449eee2 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.411152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.418875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.418875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.418875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.420543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.421964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:36.435942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:36.436890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:26:36.437850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:36.442040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 530/1065] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:36.443555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.457957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.497024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 536/1066] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:26:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:36.554491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d1cc69-f0f2-43dd-866f-adf1dd5a26f1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.600049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.600746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.601027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.601303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.602147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:36.602454 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.603920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.628750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 531/1067] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:36.633428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e8296-7d22-4cba-86e8-f4e8c12b0e86 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.743921 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e8296-7d22-4cba-86e8-f4e8c12b0e86 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.777089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.782175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.783024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.783304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.783576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.793854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.795474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:36.814424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:36.815483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:36.821781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:36.821781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:36.821781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:36.821781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:36.821781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 537/1068] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:36.823777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:36.896775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:36.935812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faf21b-f095-43be-890c-cd6fa4150029 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:36.972518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:36.973181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:36.973458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:36.973753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:36.975392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:36.975698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:36.977097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:36.990002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 532/1069] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:36.996044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.100984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc461e-9555-4b0b-a218-3e7322bd5392 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:37.135778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:37.136572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.136846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.137114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.144185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:37.145620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:37.159448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:37.160353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:37.161266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:37.161266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:37.161266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:37.161266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:37.161266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:37.161266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:37.161266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:37.161266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:37.165972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 538/1070] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:37.167399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.288529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4e254-3c95-4cac-85ba-6e3a8bb36ce9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:37.316647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:37.325805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4d343-76f3-48c9-8938-c9b74a20b5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:37.326485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d343-76f3-48c9-8938-c9b74a20b5eb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.326795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d343-76f3-48c9-8938-c9b74a20b5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.327075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4d343-76f3-48c9-8938-c9b74a20b5eb None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.328390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4d343-76f3-48c9-8938-c9b74a20b5eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:37.328390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4d343-76f3-48c9-8938-c9b74a20b5eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:37.333484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4d343-76f3-48c9-8938-c9b74a20b5eb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:37.348224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 533/1071] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:37.350148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.384604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa18852-44c7-4a43-b9fa-d2aa3fd95373 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.384940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa18852-44c7-4a43-b9fa-d2aa3fd95373 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.385295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa18852-44c7-4a43-b9fa-d2aa3fd95373 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.386745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 534/1072] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:37.391898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2cf5-99b6-400b-a0a6-3f0ccf6db542 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.392220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2cf5-99b6-400b-a0a6-3f0ccf6db542 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.392553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2cf5-99b6-400b-a0a6-3f0ccf6db542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.402934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:37.418206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a26f2cf5-99b6-400b-a0a6-3f0ccf6db542 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:37.418206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a26f2cf5-99b6-400b-a0a6-3f0ccf6db542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:37.460442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b9af77-f244-40a3-ad59-d182b895b31c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:37.483469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 535/1073] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:37.499035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69102b-67d1-4431-b791-2afd4fe3c9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:37.499952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69102b-67d1-4431-b791-2afd4fe3c9ec None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.500237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69102b-67d1-4431-b791-2afd4fe3c9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.500496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69102b-67d1-4431-b791-2afd4fe3c9ec None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/5643e9f777c94d06a2f5c687dd8919b6/roles/6f1199c39ce64672bbee1aac2d5311c6` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.502732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69102b-67d1-4431-b791-2afd4fe3c9ec None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=5643e9f777c94d06a2f5c687dd8919b6, role_id=6f1199c39ce64672bbee1aac2d5311c6)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:37.504201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69102b-67d1-4431-b791-2afd4fe3c9ec None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:37.511634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2cf5-99b6-400b-a0a6-3f0ccf6db542 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.580295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 539/1074] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:26:37 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/5643e9f777c94d06a2f5c687dd8919b6/roles/6f1199c39ce64672bbee1aac2d5311c6 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:26:37.627577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2cf5-99b6-400b-a0a6-3f0ccf6db542 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:37.649288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:37.672341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f9d8-52ee-4ccd-909b-65a68a0558f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:37.673136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f9d8-52ee-4ccd-909b-65a68a0558f1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.673425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f9d8-52ee-4ccd-909b-65a68a0558f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.673701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c857f9d8-52ee-4ccd-909b-65a68a0558f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.687113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c857f9d8-52ee-4ccd-909b-65a68a0558f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c857f9d8-52ee-4ccd-909b-65a68a0558f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:37.696184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:37.697195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:37.698049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 536/1075] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:26:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:37.707318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69102b-67d1-4431-b791-2afd4fe3c9ec None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.824513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69102b-67d1-4431-b791-2afd4fe3c9ec None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:37.827730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:37.860268 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:37.860942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:37.861225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:37.861500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:37.862245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:37.862585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:37.863950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:37.873379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 540/1076] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:26:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:37.879127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f9d8-52ee-4ccd-909b-65a68a0558f1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:37.983840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c857f9d8-52ee-4ccd-909b-65a68a0558f1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:38.017776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5c17e-f131-44a9-baac-fdf8ce577e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:38.018944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c17e-f131-44a9-baac-fdf8ce577e2c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:38.019227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c17e-f131-44a9-baac-fdf8ce577e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:38.019525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5c17e-f131-44a9-baac-fdf8ce577e2c None admin] PATH_INFO: `/v3/users/37c73670751444e4887ef41579168ebe` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:38.020711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5c17e-f131-44a9-baac-fdf8ce577e2c None admin] RBAC: Authorizing `identity:get_user(user_id=37c73670751444e4887ef41579168ebe)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:38.022909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5c17e-f131-44a9-baac-fdf8ce577e2c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:38.029352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 537/1077] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:37 2022] GET /identity/v3/users/37c73670751444e4887ef41579168ebe => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:38.030607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:38.137132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f24372-b6bf-44c7-9f92-c1b46d33c2c6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:38.173179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a741ce71-d4e7-463c-81d5-4b202efc2e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:38.174039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ce71-d4e7-463c-81d5-4b202efc2e70 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:38.174320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ce71-d4e7-463c-81d5-4b202efc2e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:38.174619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a741ce71-d4e7-463c-81d5-4b202efc2e70 None admin] PATH_INFO: `/v3/projects/0fa963faf1774b0ea76a53be5b0f596e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:38.175792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741ce71-d4e7-463c-81d5-4b202efc2e70 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa963faf1774b0ea76a53be5b0f596e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:38.177208 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a741ce71-d4e7-463c-81d5-4b202efc2e70 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:38.184585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 541/1078] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:26:38 2022] GET /identity/v3/projects/0fa963faf1774b0ea76a53be5b0f596e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:38.185501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5c17e-f131-44a9-baac-fdf8ce577e2c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:38.235800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:38.300361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5c17e-f131-44a9-baac-fdf8ce577e2c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:38.339799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5f0e95-1ea5-4356-982e-02923bdc5ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:38.341100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0e95-1ea5-4356-982e-02923bdc5ea6 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:38.341596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0e95-1ea5-4356-982e-02923bdc5ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:38.342036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5f0e95-1ea5-4356-982e-02923bdc5ea6 None admin] PATH_INFO: `/v3/projects/0fa963faf1774b0ea76a53be5b0f596e/users/37c73670751444e4887ef41579168ebe/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:38.344379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0e95-1ea5-4356-982e-02923bdc5ea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa963faf1774b0ea76a53be5b0f596e, user_id=37c73670751444e4887ef41579168ebe, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:38.346108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5f0e95-1ea5-4356-982e-02923bdc5ea6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:38.415722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 538/1079] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:26:38 2022] PUT /identity/v3/projects/0fa963faf1774b0ea76a53be5b0f596e/users/37c73670751444e4887ef41579168ebe/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:26:38.820903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5121a8-71fe-41b0-b9ee-32dd02b60ee9 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:38.821279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5121a8-71fe-41b0-b9ee-32dd02b60ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:38.821464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5121a8-71fe-41b0-b9ee-32dd02b60ee9 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:38.823027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 542/1080] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:38.828172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c51bb-2942-46b0-a1da-e1a0893938ac None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:38.828607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c51bb-2942-46b0-a1da-e1a0893938ac None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:38.828767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c51bb-2942-46b0-a1da-e1a0893938ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:38.846224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b47c51bb-2942-46b0-a1da-e1a0893938ac None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:38.847648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b47c51bb-2942-46b0-a1da-e1a0893938ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:38.917592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 539/1081] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:38.939750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5121a8-71fe-41b0-b9ee-32dd02b60ee9 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:38.977796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:39.045919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5121a8-71fe-41b0-b9ee-32dd02b60ee9 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:39.081165 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784aeb7-450c-415b-b6ca-61c9f1b917d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:39.081742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784aeb7-450c-415b-b6ca-61c9f1b917d4 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.082021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784aeb7-450c-415b-b6ca-61c9f1b917d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.082362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784aeb7-450c-415b-b6ca-61c9f1b917d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.155182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784aeb7-450c-415b-b6ca-61c9f1b917d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:39.156668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784aeb7-450c-415b-b6ca-61c9f1b917d4 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:39.190668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:39.261501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 543/1082] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:39.267468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c51bb-2942-46b0-a1da-e1a0893938ac None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:39.304541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:39.393400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c51bb-2942-46b0-a1da-e1a0893938ac None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:39.440714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf62ac-dc48-4a6a-890c-f5887245770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:39.442041 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf62ac-dc48-4a6a-890c-f5887245770c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.442497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf62ac-dc48-4a6a-890c-f5887245770c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.443521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf62ac-dc48-4a6a-890c-f5887245770c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.457656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf62ac-dc48-4a6a-890c-f5887245770c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:39.460116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf62ac-dc48-4a6a-890c-f5887245770c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-aabf62ac-dc48-4a6a-890c-f5887245770c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:39.479735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:39.480880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:39.481820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:39.481820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:39.481820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:39.481820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:39.481820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 540/1083] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:39.488300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784aeb7-450c-415b-b6ca-61c9f1b917d4 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:39.653967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784aeb7-450c-415b-b6ca-61c9f1b917d4 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:39.699132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f44920-2342-4a62-8772-7c6fe7e4ebf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:39.699804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f44920-2342-4a62-8772-7c6fe7e4ebf7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.700081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f44920-2342-4a62-8772-7c6fe7e4ebf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.700358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f44920-2342-4a62-8772-7c6fe7e4ebf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.701081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f44920-2342-4a62-8772-7c6fe7e4ebf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:39.701388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f44920-2342-4a62-8772-7c6fe7e4ebf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:39.702776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f44920-2342-4a62-8772-7c6fe7e4ebf7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:39.704517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:39.720094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 544/1084] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:39.959783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e5346-79ea-4e6a-a457-353a96cf592a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.960367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e5346-79ea-4e6a-a457-353a96cf592a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.960694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e5346-79ea-4e6a-a457-353a96cf592a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:39.963512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 541/1085] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:39.976171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdfc6-e523-4b1f-bcfb-adfa64c13b42 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:39.976688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdfc6-e523-4b1f-bcfb-adfa64c13b42 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:39.976688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21cdfc6-e523-4b1f-bcfb-adfa64c13b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:40.001910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-a21cdfc6-e523-4b1f-bcfb-adfa64c13b42 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:40.003686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a21cdfc6-e523-4b1f-bcfb-adfa64c13b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:40.095916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 545/1086] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:40.120100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e5346-79ea-4e6a-a457-353a96cf592a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:40.214680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:40.231641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e5346-79ea-4e6a-a457-353a96cf592a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:40.278354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73720-ebe4-45a9-a3d4-552df3918548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:40.279212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73720-ebe4-45a9-a3d4-552df3918548 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:40.279668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73720-ebe4-45a9-a3d4-552df3918548 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:40.280137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e73720-ebe4-45a9-a3d4-552df3918548 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:40.297025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e73720-ebe4-45a9-a3d4-552df3918548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-91e73720-ebe4-45a9-a3d4-552df3918548 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:40.308605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:40.320610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:40.324115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 542/1087] 10.222.0.60 () {56 vars in 1120 bytes} [Thu May 26 12:26:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:40.326263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cdfc6-e523-4b1f-bcfb-adfa64c13b42 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:40.439047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21cdfc6-e523-4b1f-bcfb-adfa64c13b42 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:40.468715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:40.480087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:40.480766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:40.482555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:40.482555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:40.482555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:40.482555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:40.483786 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:40.493135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 546/1088] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 26 12:26:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:40.500306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73720-ebe4-45a9-a3d4-552df3918548 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:40.635853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e73720-ebe4-45a9-a3d4-552df3918548 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:40.675255 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f85641-59e2-4a8f-9329-3ea9f091de70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:40.676148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85641-59e2-4a8f-9329-3ea9f091de70 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:40.676464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85641-59e2-4a8f-9329-3ea9f091de70 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:40.676790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f85641-59e2-4a8f-9329-3ea9f091de70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:40.691695 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f85641-59e2-4a8f-9329-3ea9f091de70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:40.694247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f85641-59e2-4a8f-9329-3ea9f091de70 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:40.702160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-35f85641-59e2-4a8f-9329-3ea9f091de70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:40.714982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:40.716819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:40.717747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:40.717747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:40.717747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:40.717747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:40.717747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 543/1089] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:26:40.722396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:40.789814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b7d54-3662-44ff-befd-b154ea41c0a9 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:40.790304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b7d54-3662-44ff-befd-b154ea41c0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:40.790777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b7d54-3662-44ff-befd-b154ea41c0a9 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:40.792928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 544/1090] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:40.800673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9d2d-c0a3-4a9e-9b85-c690ad059622 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:40.800952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9d2d-c0a3-4a9e-9b85-c690ad059622 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:40.801231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c9d2d-c0a3-4a9e-9b85-c690ad059622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:40.819715 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-446c9d2d-c0a3-4a9e-9b85-c690ad059622 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:40.821402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-446c9d2d-c0a3-4a9e-9b85-c690ad059622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:40.841616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334401e6-8f4a-401c-8049-e5d0958abd6b None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:40.883313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:40.883980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:40.884257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:40.884526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:40.885354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:40.885654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:40.887045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:40.902115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 547/1091] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:40.905570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 545/1092] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:26:40.907568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:40.930448 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c9d2d-c0a3-4a9e-9b85-c690ad059622 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:40.965692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:41.031321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b488b-b08f-401e-98fb-5cf65e8b518d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:41.069375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c9d2d-c0a3-4a9e-9b85-c690ad059622 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:41.079401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:41.080203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.080480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.080756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.093846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:41.095703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:41.102625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:41.111057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a15bb6-c39a-494a-9745-11540319f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:41.111855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a15bb6-c39a-494a-9745-11540319f7fe None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.112139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a15bb6-c39a-494a-9745-11540319f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.112415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a15bb6-c39a-494a-9745-11540319f7fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:26:41.112613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:41.113518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:41.114654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 548/1093] 10.222.0.60 () {56 vars in 1093 bytes} [Thu May 26 12:26:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:41.127688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:41.127765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a15bb6-c39a-494a-9745-11540319f7fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-83a15bb6-c39a-494a-9745-11540319f7fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:26:41.133517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:41.134641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:26:41.136589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 546/1094] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:26:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:41.140988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a15bb6-c39a-494a-9745-11540319f7fe None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:41.240932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef89be7-3c90-42f5-a180-9fa5ffa6e651 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:41.249989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:41.256803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a15bb6-c39a-494a-9745-11540319f7fe None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:41.285176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:41.285976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.286357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.286956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.288425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:41.288750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:41.290651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:41.300582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:41.301253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.301532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.301804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.303094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:41.303397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:41.304852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:41.312142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 549/1095] 10.222.0.60 () {56 vars in 1133 bytes} [Thu May 26 12:26:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:41.318541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 547/1096] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:26:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:41.318714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:41.319808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:41.378079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:41.430837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bede4a-392a-4155-81e9-3dbd16d08228 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:41.432534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c9d82-6681-40c6-a283-82846a3cf6c3 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:41.481380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b0844-5d26-4f69-8ea5-1a93b7d62146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:41.482428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b0844-5d26-4f69-8ea5-1a93b7d62146 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.482927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b0844-5d26-4f69-8ea5-1a93b7d62146 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.483357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b0844-5d26-4f69-8ea5-1a93b7d62146 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.486969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e631213-e1b8-472e-8717-2da4a96ce839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:41.488340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e631213-e1b8-472e-8717-2da4a96ce839 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.488800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e631213-e1b8-472e-8717-2da4a96ce839 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.489174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e631213-e1b8-472e-8717-2da4a96ce839 None admin] PATH_INFO: `/v3/users/37c73670751444e4887ef41579168ebe` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.491467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e631213-e1b8-472e-8717-2da4a96ce839 None admin] RBAC: Authorizing `identity:get_user(user_id=37c73670751444e4887ef41579168ebe)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:41.492910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e631213-e1b8-472e-8717-2da4a96ce839 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:41.494658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 548/1097] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:41 2022] GET /identity/v3/users/37c73670751444e4887ef41579168ebe => generated 285 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:41.500502 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e631213-e1b8-472e-8717-2da4a96ce839 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:41.525257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:41.564189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b0844-5d26-4f69-8ea5-1a93b7d62146 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:41.565546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b0844-5d26-4f69-8ea5-1a93b7d62146 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:41.622139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e631213-e1b8-472e-8717-2da4a96ce839 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:41.640178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:41.657882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878afe-4cb1-4a24-b57b-a1d525f3f23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:41.658637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878afe-4cb1-4a24-b57b-a1d525f3f23d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.658926 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878afe-4cb1-4a24-b57b-a1d525f3f23d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.659212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878afe-4cb1-4a24-b57b-a1d525f3f23d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.675562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 550/1098] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:41.681884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b0844-5d26-4f69-8ea5-1a93b7d62146 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:41.744939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4878afe-4cb1-4a24-b57b-a1d525f3f23d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:41.747078 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4878afe-4cb1-4a24-b57b-a1d525f3f23d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:41.749239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:41.791899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b0844-5d26-4f69-8ea5-1a93b7d62146 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:41.827462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:41.828165 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:41.828445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:41.828706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:41.839847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:41.841272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:26:41.859930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:41.860897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:41.861790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:26:41.861790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:26:41.861790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:26:41.861790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:41.861790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 551/1099] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:41.867343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:41.890593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 549/1100] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 12:26:41.897184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878afe-4cb1-4a24-b57b-a1d525f3f23d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:41.917422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:41.987770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf525-de21-4312-a5ef-dfdc1a871925 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:42.005569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:42.023429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878afe-4cb1-4a24-b57b-a1d525f3f23d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:42.025075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:42.025753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.026039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.026316 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.027100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:42.027408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:42.028808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:42.041944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 552/1101] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:42.047544 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:42.065411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf950bed-11e8-4f6f-8496-a4343201d2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:42.066383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950bed-11e8-4f6f-8496-a4343201d2ac None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.066692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950bed-11e8-4f6f-8496-a4343201d2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.066968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf950bed-11e8-4f6f-8496-a4343201d2ac None admin] PATH_INFO: `/v3/projects/0fa963faf1774b0ea76a53be5b0f596e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.068157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf950bed-11e8-4f6f-8496-a4343201d2ac None admin] RBAC: Authorizing `identity:get_project(project_id=0fa963faf1774b0ea76a53be5b0f596e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:42.069679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf950bed-11e8-4f6f-8496-a4343201d2ac None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:42.071492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 550/1102] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:26:41 2022] GET /identity/v3/projects/0fa963faf1774b0ea76a53be5b0f596e => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:42.079389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf950bed-11e8-4f6f-8496-a4343201d2ac None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:42.151754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4178f9-4211-4af6-b79d-a1268aa7cdca None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:42.184263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:42.186756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:42.187558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.187837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.188104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.195806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:42.197253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:42.200256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf950bed-11e8-4f6f-8496-a4343201d2ac None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:26:42.212142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:26:42.213199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:26:42.214099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 553/1103] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:26:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:26:42.219260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:42.242958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:42.243635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.243916 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.244199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.245044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=0fa963faf1774b0ea76a53be5b0f596e, user.id=37c73670751444e4887ef41579168ebe) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:42.245356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:42.246910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:42.253587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 551/1104] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:42 2022] GET /identity/v3/role_assignments?user.id=37c73670751444e4887ef41579168ebe&scope.project.id=0fa963faf1774b0ea76a53be5b0f596e&role.id=07de3e1931ca4d799df8510428e181aa => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:42.262407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:42.338924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e65f3-c7e4-4958-9969-61bc4388ab2c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:42.379195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e016d-472e-4579-bed0-2b154f2ef09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:42.381266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e016d-472e-4579-bed0-2b154f2ef09b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.381266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e016d-472e-4579-bed0-2b154f2ef09b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.381266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e016d-472e-4579-bed0-2b154f2ef09b None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.382071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e016d-472e-4579-bed0-2b154f2ef09b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:42.382247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e016d-472e-4579-bed0-2b154f2ef09b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:42.383751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e016d-472e-4579-bed0-2b154f2ef09b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:42.402913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 554/1105] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:26:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:42.404156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:42.525715 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c30b1b-e43f-430d-afb7-693b28524f90 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:42.562018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8cbc-2fe1-44d1-85de-8b9668188aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:42.562823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8cbc-2fe1-44d1-85de-8b9668188aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:42.563106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8cbc-2fe1-44d1-85de-8b9668188aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:42.563379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8cbc-2fe1-44d1-85de-8b9668188aa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:42.564254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8cbc-2fe1-44d1-85de-8b9668188aa6 None admin] RBAC: Adding query filter params (role.id=6f1199c39ce64672bbee1aac2d5311c6, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=5643e9f777c94d06a2f5c687dd8919b6) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:42.564561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8cbc-2fe1-44d1-85de-8b9668188aa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:42.566008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bd8cbc-2fe1-44d1-85de-8b9668188aa6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:42.575313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 552/1106] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:42 2022] GET /identity/v3/role_assignments?user.id=5643e9f777c94d06a2f5c687dd8919b6&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=6f1199c39ce64672bbee1aac2d5311c6 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:44.628793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603501f-1baf-412f-8d52-c375019865a2 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:44.629326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603501f-1baf-412f-8d52-c375019865a2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:44.629326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9603501f-1baf-412f-8d52-c375019865a2 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:44.630892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 555/1107] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:44.636399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4ccd-a9d9-4fa6-831a-0c14ea57d248 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:44.636829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4ccd-a9d9-4fa6-831a-0c14ea57d248 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:44.636962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db4ccd-a9d9-4fa6-831a-0c14ea57d248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:44.655495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f4db4ccd-a9d9-4fa6-831a-0c14ea57d248 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:44.656698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f4db4ccd-a9d9-4fa6-831a-0c14ea57d248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:44.666731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:44.727230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 553/1108] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:44.752753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603501f-1baf-412f-8d52-c375019865a2 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:44.852006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:44.858632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9603501f-1baf-412f-8d52-c375019865a2 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:44.891797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c3970-ed88-46ab-a26a-5fd47e125bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:44.892522 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3970-ed88-46ab-a26a-5fd47e125bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:44.892803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3970-ed88-46ab-a26a-5fd47e125bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:44.893372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c3970-ed88-46ab-a26a-5fd47e125bb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:44.894721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c3970-ed88-46ab-a26a-5fd47e125bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:44.897267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c3970-ed88-46ab-a26a-5fd47e125bb2 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:44.898910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 556/1109] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:44.904658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db4ccd-a9d9-4fa6-831a-0c14ea57d248 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:45.010499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db4ccd-a9d9-4fa6-831a-0c14ea57d248 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:45.054273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f985-f887-4e3c-b857-4aeb9c8af94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:45.055051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f985-f887-4e3c-b857-4aeb9c8af94b None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:45.055334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f985-f887-4e3c-b857-4aeb9c8af94b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:45.055598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f985-f887-4e3c-b857-4aeb9c8af94b None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:45.056313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8f985-f887-4e3c-b857-4aeb9c8af94b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:45.057738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8f985-f887-4e3c-b857-4aeb9c8af94b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:45.164446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:45.169606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 554/1110] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:26:44 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:26:47.558959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c363f-f8c7-467d-b2c2-905718aada26 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:47.559477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c363f-f8c7-467d-b2c2-905718aada26 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:47.559477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c363f-f8c7-467d-b2c2-905718aada26 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:47.560810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 557/1111] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:47.565989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae7c54-a747-40b7-a4af-79b7bc953977 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:47.566430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae7c54-a747-40b7-a4af-79b7bc953977 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:47.566551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae7c54-a747-40b7-a4af-79b7bc953977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:47.584167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-90ae7c54-a747-40b7-a4af-79b7bc953977 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:47.585380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-90ae7c54-a747-40b7-a4af-79b7bc953977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:47.659549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 555/1112] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:47.683335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c363f-f8c7-467d-b2c2-905718aada26 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:47.785651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c363f-f8c7-467d-b2c2-905718aada26 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:47.821070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55ead-8677-4020-8c8a-aa8d34599c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:47.821941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55ead-8677-4020-8c8a-aa8d34599c6f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:47.822129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55ead-8677-4020-8c8a-aa8d34599c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:47.822404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced55ead-8677-4020-8c8a-aa8d34599c6f None admin] PATH_INFO: `/v3/roles/af8d06df2b8647859f2fe7b60e0da912` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:47.823886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced55ead-8677-4020-8c8a-aa8d34599c6f None admin] RBAC: Authorizing `identity:get_role(role_id=af8d06df2b8647859f2fe7b60e0da912)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:47.825245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced55ead-8677-4020-8c8a-aa8d34599c6f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:47.826640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 558/1113] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:47 2022] GET /identity/v3/roles/af8d06df2b8647859f2fe7b60e0da912 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:47.832438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae7c54-a747-40b7-a4af-79b7bc953977 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:47.935178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae7c54-a747-40b7-a4af-79b7bc953977 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:47.964685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:47.970299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc9be5-5ae1-4ff9-8e80-6f024377b438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:47.971175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9be5-5ae1-4ff9-8e80-6f024377b438 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:47.978635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9be5-5ae1-4ff9-8e80-6f024377b438 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:47.978635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc9be5-5ae1-4ff9-8e80-6f024377b438 None admin] PATH_INFO: `/v3/users/6c0495b11be2407d89262f70c569f358` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:47.986776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc9be5-5ae1-4ff9-8e80-6f024377b438 None admin] RBAC: Authorizing `identity:get_user(user_id=6c0495b11be2407d89262f70c569f358)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:47.988220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc9be5-5ae1-4ff9-8e80-6f024377b438 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:47.991149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 556/1114] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:47 2022] GET /identity/v3/users/6c0495b11be2407d89262f70c569f358 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:47.996953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55ead-8677-4020-8c8a-aa8d34599c6f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:48.029163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:48.098333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced55ead-8677-4020-8c8a-aa8d34599c6f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:48.133828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e210dd-3e69-4a0b-862f-26d6262015bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:48.134482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e210dd-3e69-4a0b-862f-26d6262015bf None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:48.134787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e210dd-3e69-4a0b-862f-26d6262015bf None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:48.135059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e210dd-3e69-4a0b-862f-26d6262015bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:48.204121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e210dd-3e69-4a0b-862f-26d6262015bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:48.205565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e210dd-3e69-4a0b-862f-26d6262015bf None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:48.238588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:48.316962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 559/1115] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:48.323212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc9be5-5ae1-4ff9-8e80-6f024377b438 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:48.431576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc9be5-5ae1-4ff9-8e80-6f024377b438 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:48.479144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88654f-8d60-4099-a21c-44b091b18e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:48.480324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88654f-8d60-4099-a21c-44b091b18e35 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:48.480697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88654f-8d60-4099-a21c-44b091b18e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:48.481069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88654f-8d60-4099-a21c-44b091b18e35 None admin] PATH_INFO: `/v3/projects/0fa963faf1774b0ea76a53be5b0f596e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:48.482719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88654f-8d60-4099-a21c-44b091b18e35 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa963faf1774b0ea76a53be5b0f596e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:48.484663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88654f-8d60-4099-a21c-44b091b18e35 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:48.487034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 557/1116] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:26:48 2022] GET /identity/v3/projects/0fa963faf1774b0ea76a53be5b0f596e => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:48.493981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e210dd-3e69-4a0b-862f-26d6262015bf None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:48.622377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e210dd-3e69-4a0b-862f-26d6262015bf None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:48.656990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:48.662694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572c389-0838-4c33-adc8-7fbb70601e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:48.663765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c389-0838-4c33-adc8-7fbb70601e8e None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:48.664239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c389-0838-4c33-adc8-7fbb70601e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:48.669346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572c389-0838-4c33-adc8-7fbb70601e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:48.669346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572c389-0838-4c33-adc8-7fbb70601e8e None admin] RBAC: Adding query filter params (role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=0fa963faf1774b0ea76a53be5b0f596e, user.id=6c0495b11be2407d89262f70c569f358) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:48.669346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572c389-0838-4c33-adc8-7fbb70601e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:48.669346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572c389-0838-4c33-adc8-7fbb70601e8e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:48.674043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 560/1117] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:48 2022] GET /identity/v3/role_assignments?user.id=6c0495b11be2407d89262f70c569f358&scope.project.id=0fa963faf1774b0ea76a53be5b0f596e&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:50.904182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5d69-99f5-426c-947b-8e0662a2fefb None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:50.904722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5d69-99f5-426c-947b-8e0662a2fefb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:50.904722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c5d69-99f5-426c-947b-8e0662a2fefb None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:50.906096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 558/1118] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:50.911743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8645c-76c6-458a-acd2-4cb961fc3c08 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:50.912731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8645c-76c6-458a-acd2-4cb961fc3c08 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:50.912960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a8645c-76c6-458a-acd2-4cb961fc3c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:50.929904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-89a8645c-76c6-458a-acd2-4cb961fc3c08 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:50.931145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-89a8645c-76c6-458a-acd2-4cb961fc3c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:51.017525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 561/1119] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:51.042031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5d69-99f5-426c-947b-8e0662a2fefb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:51.101180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:51.148505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c5d69-99f5-426c-947b-8e0662a2fefb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:51.181681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29909f-7f35-40e1-a491-15dc890569ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:51.182453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29909f-7f35-40e1-a491-15dc890569ba None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:51.182758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29909f-7f35-40e1-a491-15dc890569ba None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:51.183026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29909f-7f35-40e1-a491-15dc890569ba None admin] PATH_INFO: `/v3/roles/af8d06df2b8647859f2fe7b60e0da912` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:51.184504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29909f-7f35-40e1-a491-15dc890569ba None admin] RBAC: Authorizing `identity:get_role(role_id=af8d06df2b8647859f2fe7b60e0da912)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:51.185865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29909f-7f35-40e1-a491-15dc890569ba None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:51.187302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 559/1120] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:51 2022] GET /identity/v3/roles/af8d06df2b8647859f2fe7b60e0da912 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:51.197175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8645c-76c6-458a-acd2-4cb961fc3c08 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:51.302307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a8645c-76c6-458a-acd2-4cb961fc3c08 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:51.329315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:51.338953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1c7df-8489-4655-a33c-2626794411a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:51.344542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1c7df-8489-4655-a33c-2626794411a3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:51.344542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1c7df-8489-4655-a33c-2626794411a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:51.344542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e1c7df-8489-4655-a33c-2626794411a3 None admin] PATH_INFO: `/v3/users/6c0495b11be2407d89262f70c569f358` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:51.344542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1c7df-8489-4655-a33c-2626794411a3 None admin] RBAC: Authorizing `identity:get_user(user_id=6c0495b11be2407d89262f70c569f358)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:51.344542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e1c7df-8489-4655-a33c-2626794411a3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:51.344956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 562/1121] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:51 2022] GET /identity/v3/users/6c0495b11be2407d89262f70c569f358 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:51.351116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29909f-7f35-40e1-a491-15dc890569ba None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:51.484904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29909f-7f35-40e1-a491-15dc890569ba None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:51.525018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:51.545128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7ec06-809b-417d-8980-ed9a64293fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:51.546557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7ec06-809b-417d-8980-ed9a64293fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:51.547005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7ec06-809b-417d-8980-ed9a64293fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:51.547452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7ec06-809b-417d-8980-ed9a64293fb1 None admin] PATH_INFO: `/v3/projects/0fa963faf1774b0ea76a53be5b0f596e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:51.549606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7ec06-809b-417d-8980-ed9a64293fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa963faf1774b0ea76a53be5b0f596e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:51.552735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7ec06-809b-417d-8980-ed9a64293fb1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:51.555842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 560/1122] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:26:51 2022] GET /identity/v3/projects/0fa963faf1774b0ea76a53be5b0f596e => generated 311 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:26:51.562961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1c7df-8489-4655-a33c-2626794411a3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:51.668027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e1c7df-8489-4655-a33c-2626794411a3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:51.703760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f465896-c97c-481f-b353-cc7854e281cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:51.704655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465896-c97c-481f-b353-cc7854e281cc None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:51.704927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465896-c97c-481f-b353-cc7854e281cc None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:51.705194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465896-c97c-481f-b353-cc7854e281cc None admin] PATH_INFO: `/v3/projects/0fa963faf1774b0ea76a53be5b0f596e/users/6c0495b11be2407d89262f70c569f358/roles/af8d06df2b8647859f2fe7b60e0da912` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:51.707453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f465896-c97c-481f-b353-cc7854e281cc None admin] RBAC: Authorizing `identity:create_grant(project_id=0fa963faf1774b0ea76a53be5b0f596e, user_id=6c0495b11be2407d89262f70c569f358, role_id=af8d06df2b8647859f2fe7b60e0da912)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:51.708915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f465896-c97c-481f-b353-cc7854e281cc None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:51.780965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 563/1123] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:26:51 2022] PUT /identity/v3/projects/0fa963faf1774b0ea76a53be5b0f596e/users/6c0495b11be2407d89262f70c569f358/roles/af8d06df2b8647859f2fe7b60e0da912 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:26:54.046358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14569-d07d-4ba6-af21-5bafe6e127fd None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:54.046937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14569-d07d-4ba6-af21-5bafe6e127fd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:54.046937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e14569-d07d-4ba6-af21-5bafe6e127fd None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:54.048317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 561/1124] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:54.054719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92fb0-cfd0-4516-a499-1814febf86e0 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:54.055223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92fb0-cfd0-4516-a499-1814febf86e0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:54.055324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe92fb0-cfd0-4516-a499-1814febf86e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:54.072947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-cfe92fb0-cfd0-4516-a499-1814febf86e0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:54.074180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cfe92fb0-cfd0-4516-a499-1814febf86e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:54.133827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:54.152699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 564/1125] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:54.178418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14569-d07d-4ba6-af21-5bafe6e127fd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:54.293482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e14569-d07d-4ba6-af21-5bafe6e127fd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:54.330616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc452859-e906-4ec5-b95b-60ea2f52f215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:54.331399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc452859-e906-4ec5-b95b-60ea2f52f215 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:54.331677 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc452859-e906-4ec5-b95b-60ea2f52f215 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:54.331946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc452859-e906-4ec5-b95b-60ea2f52f215 None admin] PATH_INFO: `/v3/roles/af8d06df2b8647859f2fe7b60e0da912` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:54.333565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc452859-e906-4ec5-b95b-60ea2f52f215 None admin] RBAC: Authorizing `identity:get_role(role_id=af8d06df2b8647859f2fe7b60e0da912)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:54.335132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc452859-e906-4ec5-b95b-60ea2f52f215 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:54.336577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 562/1126] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:54 2022] GET /identity/v3/roles/af8d06df2b8647859f2fe7b60e0da912 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:54.342975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92fb0-cfd0-4516-a499-1814febf86e0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:54.472896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe92fb0-cfd0-4516-a499-1814febf86e0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:54.510751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eadcc9-e50c-4757-9c16-d9a9b7fccc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:54.511663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eadcc9-e50c-4757-9c16-d9a9b7fccc92 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:54.511945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eadcc9-e50c-4757-9c16-d9a9b7fccc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:54.512219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eadcc9-e50c-4757-9c16-d9a9b7fccc92 None admin] PATH_INFO: `/v3/users/6c0495b11be2407d89262f70c569f358` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:54.513435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eadcc9-e50c-4757-9c16-d9a9b7fccc92 None admin] RBAC: Authorizing `identity:get_user(user_id=6c0495b11be2407d89262f70c569f358)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:54.514950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eadcc9-e50c-4757-9c16-d9a9b7fccc92 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:54.516640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 565/1127] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:26:54 2022] GET /identity/v3/users/6c0495b11be2407d89262f70c569f358 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:54.523667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc452859-e906-4ec5-b95b-60ea2f52f215 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:54.587552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:54.631895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc452859-e906-4ec5-b95b-60ea2f52f215 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:54.669822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81197f68-85ce-42b2-83cc-9a5f925fb7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:54.670497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81197f68-85ce-42b2-83cc-9a5f925fb7cf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:54.670811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81197f68-85ce-42b2-83cc-9a5f925fb7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:54.671086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81197f68-85ce-42b2-83cc-9a5f925fb7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:54.751265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81197f68-85ce-42b2-83cc-9a5f925fb7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:54.752715 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81197f68-85ce-42b2-83cc-9a5f925fb7cf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:54.815918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:54.869721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 563/1128] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:26:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:26:54.875738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eadcc9-e50c-4757-9c16-d9a9b7fccc92 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:54.933197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:54.985010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eadcc9-e50c-4757-9c16-d9a9b7fccc92 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:55.035668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6777ddd-e24e-4a29-af77-9390db113773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:55.036736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6777ddd-e24e-4a29-af77-9390db113773 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:55.037646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6777ddd-e24e-4a29-af77-9390db113773 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:55.037956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6777ddd-e24e-4a29-af77-9390db113773 None admin] PATH_INFO: `/v3/projects/0fa963faf1774b0ea76a53be5b0f596e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:55.039232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6777ddd-e24e-4a29-af77-9390db113773 None admin] RBAC: Authorizing `identity:get_project(project_id=0fa963faf1774b0ea76a53be5b0f596e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:55.040848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6777ddd-e24e-4a29-af77-9390db113773 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:55.042888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 566/1129] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:26:54 2022] GET /identity/v3/projects/0fa963faf1774b0ea76a53be5b0f596e => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:55.049181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81197f68-85ce-42b2-83cc-9a5f925fb7cf None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:55.157869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81197f68-85ce-42b2-83cc-9a5f925fb7cf None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:55.196848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8f379-10f8-4cd8-894a-c7db7686daa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:55.197521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f379-10f8-4cd8-894a-c7db7686daa4 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:55.197801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f379-10f8-4cd8-894a-c7db7686daa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:55.198073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8f379-10f8-4cd8-894a-c7db7686daa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:55.198950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8f379-10f8-4cd8-894a-c7db7686daa4 None admin] RBAC: Adding query filter params (role.id=af8d06df2b8647859f2fe7b60e0da912, scope.project.id=0fa963faf1774b0ea76a53be5b0f596e, user.id=6c0495b11be2407d89262f70c569f358) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:26:55.199263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8f379-10f8-4cd8-894a-c7db7686daa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:55.200736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8f379-10f8-4cd8-894a-c7db7686daa4 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:55.207524 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 564/1130] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:26:55 2022] GET /identity/v3/role_assignments?user.id=6c0495b11be2407d89262f70c569f358&scope.project.id=0fa963faf1774b0ea76a53be5b0f596e&role.id=af8d06df2b8647859f2fe7b60e0da912 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:57.532050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745c6a8-e8ca-42f1-8b4a-7ac297d99ca4 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:57.532587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745c6a8-e8ca-42f1-8b4a-7ac297d99ca4 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:57.532587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8745c6a8-e8ca-42f1-8b4a-7ac297d99ca4 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:57.533997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 567/1131] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:26:57.540738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca07ae-4916-4e4a-96e1-424fbc6148c8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:57.541291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca07ae-4916-4e4a-96e1-424fbc6148c8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:57.541291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca07ae-4916-4e4a-96e1-424fbc6148c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:57.559276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f1ca07ae-4916-4e4a-96e1-424fbc6148c8 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:26:57.560534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f1ca07ae-4916-4e4a-96e1-424fbc6148c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:26:57.579761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:57.633556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 565/1132] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:26:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:26:57.658658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745c6a8-e8ca-42f1-8b4a-7ac297d99ca4 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:57.773027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8745c6a8-e8ca-42f1-8b4a-7ac297d99ca4 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:57.795175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:26:57.810552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72069a28-a09c-4d24-9f83-84890b145933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:57.811345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72069a28-a09c-4d24-9f83-84890b145933 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:57.811776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72069a28-a09c-4d24-9f83-84890b145933 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:57.811917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72069a28-a09c-4d24-9f83-84890b145933 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:57.813162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72069a28-a09c-4d24-9f83-84890b145933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:57.814618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72069a28-a09c-4d24-9f83-84890b145933 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:57.816263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 568/1133] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:26:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:26:57.823650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca07ae-4916-4e4a-96e1-424fbc6148c8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:26:57.930658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca07ae-4916-4e4a-96e1-424fbc6148c8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:26:57.968442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6725c-753d-443c-83cc-c0b77f3695f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:26:57.969106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6725c-753d-443c-83cc-c0b77f3695f0 None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:26:57.969384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6725c-753d-443c-83cc-c0b77f3695f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:26:57.969653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6725c-753d-443c-83cc-c0b77f3695f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:26:57.970357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6725c-753d-443c-83cc-c0b77f3695f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:26:57.971821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6725c-753d-443c-83cc-c0b77f3695f0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:26:58.107873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 566/1134] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:26:57 2022] POST /identity/v3/projects => generated 311 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:27:00.450778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ea63-cf17-4ff1-acc7-3f839d97592a None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:00.451310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ea63-cf17-4ff1-acc7-3f839d97592a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:00.451310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e4ea63-cf17-4ff1-acc7-3f839d97592a None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:00.452707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 569/1135] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:00.458144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e492-7746-4eea-b1a3-44223ed18107 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:00.459176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e492-7746-4eea-b1a3-44223ed18107 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:00.459378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4e492-7746-4eea-b1a3-44223ed18107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:00.471746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:00.477800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-45d4e492-7746-4eea-b1a3-44223ed18107 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:00.479082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45d4e492-7746-4eea-b1a3-44223ed18107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:00.554259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 567/1136] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:00.586148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4ea63-cf17-4ff1-acc7-3f839d97592a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:00.694577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e4ea63-cf17-4ff1-acc7-3f839d97592a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:00.728831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b4333-bc3c-4265-bace-4e2f09f19495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:00.729631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b4333-bc3c-4265-bace-4e2f09f19495 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:00.729908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b4333-bc3c-4265-bace-4e2f09f19495 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:00.730180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b4333-bc3c-4265-bace-4e2f09f19495 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:00.731382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b4333-bc3c-4265-bace-4e2f09f19495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:00.732829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b4333-bc3c-4265-bace-4e2f09f19495 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:00.734465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 570/1137] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:27:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:00.740430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4e492-7746-4eea-b1a3-44223ed18107 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:00.847518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4e492-7746-4eea-b1a3-44223ed18107 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:00.905153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203f4de-c870-4ebe-a4de-0504b8135ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:00.905820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f4de-c870-4ebe-a4de-0504b8135ced None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:00.906098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f4de-c870-4ebe-a4de-0504b8135ced None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:00.906369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203f4de-c870-4ebe-a4de-0504b8135ced None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:00.907114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203f4de-c870-4ebe-a4de-0504b8135ced None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:00.908533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203f4de-c870-4ebe-a4de-0504b8135ced None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:00.917058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:01.032191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 568/1138] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:27:00 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:27:03.378318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366be1-e3cc-43d7-a764-c91907f64c6f None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:03.379069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366be1-e3cc-43d7-a764-c91907f64c6f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:03.379069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8366be1-e3cc-43d7-a764-c91907f64c6f None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:03.380356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 571/1139] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:03.386803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146d043-a92e-46e6-800d-31b305353942 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:03.395608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146d043-a92e-46e6-800d-31b305353942 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:03.395608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146d043-a92e-46e6-800d-31b305353942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:03.405703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2146d043-a92e-46e6-800d-31b305353942 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:03.407076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2146d043-a92e-46e6-800d-31b305353942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:03.479232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 569/1140] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:03.503789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366be1-e3cc-43d7-a764-c91907f64c6f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:03.567898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:03.614167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8366be1-e3cc-43d7-a764-c91907f64c6f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:03.650304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fa1f8-7cfb-4bcc-8678-8bfec7447d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:03.651135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa1f8-7cfb-4bcc-8678-8bfec7447d27 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:03.651412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa1f8-7cfb-4bcc-8678-8bfec7447d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:03.651686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fa1f8-7cfb-4bcc-8678-8bfec7447d27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:03.662560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fa1f8-7cfb-4bcc-8678-8bfec7447d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-f80fa1f8-7cfb-4bcc-8678-8bfec7447d27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:03.670198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:03.671498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:27:03.672633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 572/1141] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:27:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:27:03.678656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146d043-a92e-46e6-800d-31b305353942 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:03.788184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146d043-a92e-46e6-800d-31b305353942 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:03.814500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:03.830120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:03.830120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:03.830120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:03.830120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:03.830587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:03.830587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:03.831196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:03.840572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 570/1142] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:27:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:03.846406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fa1f8-7cfb-4bcc-8678-8bfec7447d27 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:03.951925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fa1f8-7cfb-4bcc-8678-8bfec7447d27 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:03.968947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:03.987522 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcabb4-207c-4bd6-a576-08491dad3e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:03.988404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcabb4-207c-4bd6-a576-08491dad3e3a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:03.988689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcabb4-207c-4bd6-a576-08491dad3e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:03.988965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfcabb4-207c-4bd6-a576-08491dad3e3a None admin] PATH_INFO: `/v3/users/38e54781db0c4da6bec8f4634ce4b4d4` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:04.002767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcabb4-207c-4bd6-a576-08491dad3e3a None admin] RBAC: Authorizing `identity:get_user(user_id=38e54781db0c4da6bec8f4634ce4b4d4)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:04.004218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfcabb4-207c-4bd6-a576-08491dad3e3a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:04.006388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 573/1143] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:27:03 2022] GET /identity/v3/users/38e54781db0c4da6bec8f4634ce4b4d4 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:04.012218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:04.117196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dba49-fb09-4ae9-854f-0774fe26e74b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:04.154470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073916-40b8-4970-86e6-e18e7450d06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:04.160178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073916-40b8-4970-86e6-e18e7450d06f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:04.160178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073916-40b8-4970-86e6-e18e7450d06f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:04.160178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073916-40b8-4970-86e6-e18e7450d06f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:04.221555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:04.237407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66073916-40b8-4970-86e6-e18e7450d06f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:04.238926 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66073916-40b8-4970-86e6-e18e7450d06f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:04.343959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 571/1144] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:27:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:04.351455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcabb4-207c-4bd6-a576-08491dad3e3a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:04.476465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfcabb4-207c-4bd6-a576-08491dad3e3a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:04.510825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab0a8b-0995-4918-9f42-892f89379c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:04.511693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0a8b-0995-4918-9f42-892f89379c6d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:04.511970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0a8b-0995-4918-9f42-892f89379c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:04.512237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab0a8b-0995-4918-9f42-892f89379c6d None admin] PATH_INFO: `/v3/projects/b7b80427dd7f4a639a372521f23365b3` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:04.513415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab0a8b-0995-4918-9f42-892f89379c6d None admin] RBAC: Authorizing `identity:get_project(project_id=b7b80427dd7f4a639a372521f23365b3)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:04.514854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab0a8b-0995-4918-9f42-892f89379c6d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:04.516543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 574/1145] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:27:04 2022] GET /identity/v3/projects/b7b80427dd7f4a639a372521f23365b3 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:04.523688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073916-40b8-4970-86e6-e18e7450d06f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:04.609029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:04.625400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073916-40b8-4970-86e6-e18e7450d06f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:04.662716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd472e-9abb-46d4-94cc-a2c0b3f60140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:04.663376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd472e-9abb-46d4-94cc-a2c0b3f60140 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:04.663657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd472e-9abb-46d4-94cc-a2c0b3f60140 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:04.663925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd472e-9abb-46d4-94cc-a2c0b3f60140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:04.666829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd472e-9abb-46d4-94cc-a2c0b3f60140 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=b7b80427dd7f4a639a372521f23365b3, user.id=38e54781db0c4da6bec8f4634ce4b4d4) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:04.667192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd472e-9abb-46d4-94cc-a2c0b3f60140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:04.668644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd472e-9abb-46d4-94cc-a2c0b3f60140 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:04.675043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 572/1146] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:27:04 2022] GET /identity/v3/role_assignments?user.id=38e54781db0c4da6bec8f4634ce4b4d4&scope.project.id=b7b80427dd7f4a639a372521f23365b3&role.id=07de3e1931ca4d799df8510428e181aa => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:06.920446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5abb3-b77f-470f-8a65-9b44c59de3ed None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:06.921030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5abb3-b77f-470f-8a65-9b44c59de3ed None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:06.921030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5abb3-b77f-470f-8a65-9b44c59de3ed None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:06.922346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 575/1147] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:06.928329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8edb2f-236a-4b12-8653-b9463afd2baa None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:06.928832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8edb2f-236a-4b12-8653-b9463afd2baa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:06.929044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8edb2f-236a-4b12-8653-b9463afd2baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:06.945750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8e8edb2f-236a-4b12-8653-b9463afd2baa None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:06.946980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8e8edb2f-236a-4b12-8653-b9463afd2baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:07.022770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 573/1148] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:07.051563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5abb3-b77f-470f-8a65-9b44c59de3ed None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:07.104051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:07.160735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5abb3-b77f-470f-8a65-9b44c59de3ed None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:07.195411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c59ea-3fcc-4a0a-9a8d-2d6e935e1e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:07.196101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c59ea-3fcc-4a0a-9a8d-2d6e935e1e18 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:07.196374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c59ea-3fcc-4a0a-9a8d-2d6e935e1e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:07.196644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c59ea-3fcc-4a0a-9a8d-2d6e935e1e18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:07.206775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c59ea-3fcc-4a0a-9a8d-2d6e935e1e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-567c59ea-3fcc-4a0a-9a8d-2d6e935e1e18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:07.215003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:07.216157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:27:07.217194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 576/1149] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:27:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:07.222296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8edb2f-236a-4b12-8653-b9463afd2baa None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:07.307386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:07.331389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8edb2f-236a-4b12-8653-b9463afd2baa None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:07.365872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:07.366565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:07.366853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:07.367132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:07.367870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:07.368174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:07.369531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:07.377775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 574/1150] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:27:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:07.384356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c59ea-3fcc-4a0a-9a8d-2d6e935e1e18 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:07.485318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c59ea-3fcc-4a0a-9a8d-2d6e935e1e18 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:07.486850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:07.520421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d185bf-9418-46b5-9304-fbc3c834ad8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:07.521981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d185bf-9418-46b5-9304-fbc3c834ad8f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:07.522264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d185bf-9418-46b5-9304-fbc3c834ad8f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:07.522553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d185bf-9418-46b5-9304-fbc3c834ad8f None admin] PATH_INFO: `/v3/users/38e54781db0c4da6bec8f4634ce4b4d4` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:07.523758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d185bf-9418-46b5-9304-fbc3c834ad8f None admin] RBAC: Authorizing `identity:get_user(user_id=38e54781db0c4da6bec8f4634ce4b4d4)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:07.525196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d185bf-9418-46b5-9304-fbc3c834ad8f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:07.526883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 577/1151] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:27:07 2022] GET /identity/v3/users/38e54781db0c4da6bec8f4634ce4b4d4 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:07.532631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:07.635094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a12ae-53f9-4b74-8943-376793120a9b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:07.669316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b965edf8-5228-4e37-819b-af8ab9357f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:07.670177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965edf8-5228-4e37-819b-af8ab9357f60 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:07.670452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965edf8-5228-4e37-819b-af8ab9357f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:07.670755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965edf8-5228-4e37-819b-af8ab9357f60 None admin] PATH_INFO: `/v3/projects/b7b80427dd7f4a639a372521f23365b3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:07.671942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965edf8-5228-4e37-819b-af8ab9357f60 None admin] RBAC: Authorizing `identity:get_project(project_id=b7b80427dd7f4a639a372521f23365b3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:07.673360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b965edf8-5228-4e37-819b-af8ab9357f60 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:07.675083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 575/1152] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:27:07 2022] GET /identity/v3/projects/b7b80427dd7f4a639a372521f23365b3 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:07.682207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d185bf-9418-46b5-9304-fbc3c834ad8f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:07.785901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d185bf-9418-46b5-9304-fbc3c834ad8f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:07.822613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d38041-8243-4f30-9231-a28ae8c24609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:07.823505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d38041-8243-4f30-9231-a28ae8c24609 None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:07.823788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d38041-8243-4f30-9231-a28ae8c24609 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:07.824059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d38041-8243-4f30-9231-a28ae8c24609 None admin] PATH_INFO: `/v3/projects/b7b80427dd7f4a639a372521f23365b3/users/38e54781db0c4da6bec8f4634ce4b4d4/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:07.826023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d38041-8243-4f30-9231-a28ae8c24609 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7b80427dd7f4a639a372521f23365b3, user_id=38e54781db0c4da6bec8f4634ce4b4d4, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:07.827475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d38041-8243-4f30-9231-a28ae8c24609 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:07.923550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 578/1153] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:27:07 2022] PUT /identity/v3/projects/b7b80427dd7f4a639a372521f23365b3/users/38e54781db0c4da6bec8f4634ce4b4d4/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:27:10.244108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f89db-6211-4c97-92ff-d9c9ab988c16 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.244713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f89db-6211-4c97-92ff-d9c9ab988c16 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.244713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f89db-6211-4c97-92ff-d9c9ab988c16 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.246049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 576/1154] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:10.251994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ef7f-df22-41df-81a0-378004d7b0cf None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.252537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ef7f-df22-41df-81a0-378004d7b0cf None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.252537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255ef7f-df22-41df-81a0-378004d7b0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.273087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-0255ef7f-df22-41df-81a0-378004d7b0cf None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:10.274339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0255ef7f-df22-41df-81a0-378004d7b0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:10.301663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:10.359413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 579/1155] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:10.386168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f89db-6211-4c97-92ff-d9c9ab988c16 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:10.404981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:10.527007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f89db-6211-4c97-92ff-d9c9ab988c16 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:10.565888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f447a0d-580e-4529-9591-41726216d3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:10.566733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447a0d-580e-4529-9591-41726216d3bc None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.567013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447a0d-580e-4529-9591-41726216d3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.567283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f447a0d-580e-4529-9591-41726216d3bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.580226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f447a0d-580e-4529-9591-41726216d3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-3f447a0d-580e-4529-9591-41726216d3bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:10.589156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:10.590427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:27:10.591507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 577/1156] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:10.598637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255ef7f-df22-41df-81a0-378004d7b0cf None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:10.719227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255ef7f-df22-41df-81a0-378004d7b0cf None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:10.766254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:10.766981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.767267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.767535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.768556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:10.768872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:10.770292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:10.780200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 580/1157] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:10.786232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f447a0d-580e-4529-9591-41726216d3bc None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:10.863923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:10.899822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f447a0d-580e-4529-9591-41726216d3bc None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:10.934981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f829a4-0bba-48e4-86d7-33ebd922297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:10.935865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f829a4-0bba-48e4-86d7-33ebd922297b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:10.936142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f829a4-0bba-48e4-86d7-33ebd922297b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:10.936413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f829a4-0bba-48e4-86d7-33ebd922297b None admin] PATH_INFO: `/v3/users/38e54781db0c4da6bec8f4634ce4b4d4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:10.937614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f829a4-0bba-48e4-86d7-33ebd922297b None admin] RBAC: Authorizing `identity:get_user(user_id=38e54781db0c4da6bec8f4634ce4b4d4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:10.939084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f829a4-0bba-48e4-86d7-33ebd922297b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:10.940748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 578/1158] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:27:10 2022] GET /identity/v3/users/38e54781db0c4da6bec8f4634ce4b4d4 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:10.947345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:10.974058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:11.054605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196be6d-368b-4576-b620-1ad124a73b12 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:11.092592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e9dc-98d6-4cdd-b8be-5adf688849d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:11.093259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e9dc-98d6-4cdd-b8be-5adf688849d3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:11.093542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e9dc-98d6-4cdd-b8be-5adf688849d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:11.093816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796e9dc-98d6-4cdd-b8be-5adf688849d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:11.170501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e9dc-98d6-4cdd-b8be-5adf688849d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:11.171985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796e9dc-98d6-4cdd-b8be-5adf688849d3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:11.200093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:11.295845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 581/1159] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:27:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:11.303013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f829a4-0bba-48e4-86d7-33ebd922297b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:11.422753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f829a4-0bba-48e4-86d7-33ebd922297b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:11.468548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a93ef-e2d9-4200-b408-d3df2842382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:11.469424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a93ef-e2d9-4200-b408-d3df2842382f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:11.469710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a93ef-e2d9-4200-b408-d3df2842382f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:11.469986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a93ef-e2d9-4200-b408-d3df2842382f None admin] PATH_INFO: `/v3/projects/b7b80427dd7f4a639a372521f23365b3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:11.471373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a93ef-e2d9-4200-b408-d3df2842382f None admin] RBAC: Authorizing `identity:get_project(project_id=b7b80427dd7f4a639a372521f23365b3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:11.472822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a93ef-e2d9-4200-b408-d3df2842382f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:11.475266 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 579/1160] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:27:11 2022] GET /identity/v3/projects/b7b80427dd7f4a639a372521f23365b3 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:11.481713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e9dc-98d6-4cdd-b8be-5adf688849d3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:11.589964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796e9dc-98d6-4cdd-b8be-5adf688849d3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:11.617881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:11.630446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363749a-6c9f-4077-9df7-df4b33252801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:11.631370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363749a-6c9f-4077-9df7-df4b33252801 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:11.631661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363749a-6c9f-4077-9df7-df4b33252801 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:11.631937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363749a-6c9f-4077-9df7-df4b33252801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:11.632860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363749a-6c9f-4077-9df7-df4b33252801 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=b7b80427dd7f4a639a372521f23365b3, user.id=38e54781db0c4da6bec8f4634ce4b4d4) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:11.633178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363749a-6c9f-4077-9df7-df4b33252801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:11.634709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363749a-6c9f-4077-9df7-df4b33252801 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:11.641153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 582/1161] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:27:11 2022] GET /identity/v3/role_assignments?user.id=38e54781db0c4da6bec8f4634ce4b4d4&scope.project.id=b7b80427dd7f4a639a372521f23365b3&role.id=07de3e1931ca4d799df8510428e181aa => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:14.020543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcb8a1-d75b-477c-837c-2c2fd2fc0548 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:14.021166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcb8a1-d75b-477c-837c-2c2fd2fc0548 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:14.021166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcb8a1-d75b-477c-837c-2c2fd2fc0548 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:14.023092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 580/1162] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:14.028857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1dd8-6c2f-48a2-b21d-3ce4b69594c6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:14.029326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1dd8-6c2f-48a2-b21d-3ce4b69594c6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:14.029441 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb1dd8-6c2f-48a2-b21d-3ce4b69594c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:14.046482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9beb1dd8-6c2f-48a2-b21d-3ce4b69594c6 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:14.047696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9beb1dd8-6c2f-48a2-b21d-3ce4b69594c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:14.116008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 583/1163] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:14.139661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcb8a1-d75b-477c-837c-2c2fd2fc0548 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:14.143770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:14.243993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcb8a1-d75b-477c-837c-2c2fd2fc0548 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:14.278768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38dd3-6937-4c1d-ab47-95ac68b26728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:14.279857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38dd3-6937-4c1d-ab47-95ac68b26728 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:14.279857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38dd3-6937-4c1d-ab47-95ac68b26728 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:14.279857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d38dd3-6937-4c1d-ab47-95ac68b26728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:14.350722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d38dd3-6937-4c1d-ab47-95ac68b26728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:14.352168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d38dd3-6937-4c1d-ab47-95ac68b26728 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:14.354898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:14.457833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 581/1164] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:27:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:14.464850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb1dd8-6c2f-48a2-b21d-3ce4b69594c6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:14.572100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9beb1dd8-6c2f-48a2-b21d-3ce4b69594c6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:14.589305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:14.607398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2967af-3ce1-44dd-983f-e9f89499bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:14.608206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2967af-3ce1-44dd-983f-e9f89499bd32 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:14.608490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2967af-3ce1-44dd-983f-e9f89499bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:14.608763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2967af-3ce1-44dd-983f-e9f89499bd32 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:14.616145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2967af-3ce1-44dd-983f-e9f89499bd32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:14.617595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2967af-3ce1-44dd-983f-e9f89499bd32 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-bc2967af-3ce1-44dd-983f-e9f89499bd32 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:14.632844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:14.634161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:27:14.635514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 584/1165] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:27:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:14.642598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38dd3-6937-4c1d-ab47-95ac68b26728 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:14.745712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d38dd3-6937-4c1d-ab47-95ac68b26728 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:14.748135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:14.782943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541cdd-9e6c-48a0-83e4-1f73e6120daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:14.784086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541cdd-9e6c-48a0-83e4-1f73e6120daf None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:14.784591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541cdd-9e6c-48a0-83e4-1f73e6120daf None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:14.785082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541cdd-9e6c-48a0-83e4-1f73e6120daf None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:14.786061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541cdd-9e6c-48a0-83e4-1f73e6120daf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:14.786367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541cdd-9e6c-48a0-83e4-1f73e6120daf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:14.788296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541cdd-9e6c-48a0-83e4-1f73e6120daf None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:14.797943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 582/1166] 10.222.0.60 () {56 vars in 1115 bytes} [Thu May 26 12:27:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:17.044547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d7cb-434b-4d18-bd1f-1ccf0cd12c5d None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:17.045080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d7cb-434b-4d18-bd1f-1ccf0cd12c5d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:17.045080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d7cb-434b-4d18-bd1f-1ccf0cd12c5d None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:17.046561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 585/1167] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:17.051971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cea531-97ab-4d44-9d5c-05d62fbc24d9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:17.052364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cea531-97ab-4d44-9d5c-05d62fbc24d9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:17.053263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cea531-97ab-4d44-9d5c-05d62fbc24d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:17.070164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a3cea531-97ab-4d44-9d5c-05d62fbc24d9 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:17.071412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a3cea531-97ab-4d44-9d5c-05d62fbc24d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:17.144059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 583/1168] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:17.169199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d7cb-434b-4d18-bd1f-1ccf0cd12c5d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:17.282147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d7cb-434b-4d18-bd1f-1ccf0cd12c5d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:17.320163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29f950-4212-4798-aa46-c8b43b2e0d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:17.320748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29f950-4212-4798-aa46-c8b43b2e0d4e None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:17.321025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29f950-4212-4798-aa46-c8b43b2e0d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:17.321292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29f950-4212-4798-aa46-c8b43b2e0d4e None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:17.322065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29f950-4212-4798-aa46-c8b43b2e0d4e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:17.323460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29f950-4212-4798-aa46-c8b43b2e0d4e None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:17.410991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 586/1169] 10.222.0.60 () {60 vars in 1138 bytes} [Thu May 26 12:27:17 2022] POST /identity/v3/domains => generated 267 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:27:19.686799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4310-49d9-4906-a1a6-3baa732d908b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:19.687357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4310-49d9-4906-a1a6-3baa732d908b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:19.687357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87b4310-49d9-4906-a1a6-3baa732d908b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:19.688728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 584/1170] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:19.694547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577710-439a-4c94-bec0-0799f3e3ec03 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:19.694966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577710-439a-4c94-bec0-0799f3e3ec03 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:19.695090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577710-439a-4c94-bec0-0799f3e3ec03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:19.712108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7a577710-439a-4c94-bec0-0799f3e3ec03 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:19.713322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7a577710-439a-4c94-bec0-0799f3e3ec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:19.744643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:19.784398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 587/1171] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:19.809895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b4310-49d9-4906-a1a6-3baa732d908b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:19.918318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:19.922896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87b4310-49d9-4906-a1a6-3baa732d908b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:19.979626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef52f87-7eb4-490c-a92b-b24027ac9c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:19.980404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef52f87-7eb4-490c-a92b-b24027ac9c9a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:19.980681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef52f87-7eb4-490c-a92b-b24027ac9c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:19.980950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef52f87-7eb4-490c-a92b-b24027ac9c9a None admin] PATH_INFO: `/v3/domains/080169b135cb42d990cd3175e65fec21` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:19.991665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef52f87-7eb4-490c-a92b-b24027ac9c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=080169b135cb42d990cd3175e65fec21)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:19.993098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef52f87-7eb4-490c-a92b-b24027ac9c9a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:19.994779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 585/1172] 10.222.0.60 () {56 vars in 1183 bytes} [Thu May 26 12:27:19 2022] GET /identity/v3/domains/080169b135cb42d990cd3175e65fec21 => generated 267 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:20.000663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a577710-439a-4c94-bec0-0799f3e3ec03 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:20.101628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a577710-439a-4c94-bec0-0799f3e3ec03 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:20.136112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aaaa16-b6d9-4a3b-bd07-7c35a52d22bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:20.136775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaaa16-b6d9-4a3b-bd07-7c35a52d22bb None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:20.137053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaaa16-b6d9-4a3b-bd07-7c35a52d22bb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:20.137324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aaaa16-b6d9-4a3b-bd07-7c35a52d22bb None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:20.138028 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaaa16-b6d9-4a3b-bd07-7c35a52d22bb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:20.139505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aaaa16-b6d9-4a3b-bd07-7c35a52d22bb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:20.239290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 588/1173] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:27:19 2022] POST /identity/v3/projects => generated 361 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:27:22.552111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124d3e0-dac7-4865-aaa4-9eeebd09da5d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:22.552712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124d3e0-dac7-4865-aaa4-9eeebd09da5d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:22.552712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4124d3e0-dac7-4865-aaa4-9eeebd09da5d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:22.554112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 586/1174] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:22.559404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a1b9-a836-43be-b98e-0825fb7a6780 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:22.559854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a1b9-a836-43be-b98e-0825fb7a6780 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:22.559955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5a1b9-a836-43be-b98e-0825fb7a6780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:22.577400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f4a5a1b9-a836-43be-b98e-0825fb7a6780 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:22.578619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f4a5a1b9-a836-43be-b98e-0825fb7a6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:22.593164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:22.654157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 589/1175] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:22.679038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124d3e0-dac7-4865-aaa4-9eeebd09da5d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:22.786370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4124d3e0-dac7-4865-aaa4-9eeebd09da5d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:22.821334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2419499-4a39-4e24-80f0-8b6aed4912a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:22.822113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419499-4a39-4e24-80f0-8b6aed4912a2 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:22.822387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419499-4a39-4e24-80f0-8b6aed4912a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:22.822682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419499-4a39-4e24-80f0-8b6aed4912a2 None admin] PATH_INFO: `/v3/domains/080169b135cb42d990cd3175e65fec21` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:22.823917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2419499-4a39-4e24-80f0-8b6aed4912a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=080169b135cb42d990cd3175e65fec21)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:22.825364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2419499-4a39-4e24-80f0-8b6aed4912a2 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:22.827111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 587/1176] 10.222.0.60 () {56 vars in 1183 bytes} [Thu May 26 12:27:22 2022] GET /identity/v3/domains/080169b135cb42d990cd3175e65fec21 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:22.832929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5a1b9-a836-43be-b98e-0825fb7a6780 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:22.942662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5a1b9-a836-43be-b98e-0825fb7a6780 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:22.978552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50ff27-1418-460a-b94d-abe96664cdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:22.979241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ff27-1418-460a-b94d-abe96664cdd0 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:22.979517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ff27-1418-460a-b94d-abe96664cdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:22.979783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50ff27-1418-460a-b94d-abe96664cdd0 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:22.980488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50ff27-1418-460a-b94d-abe96664cdd0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:22.981926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50ff27-1418-460a-b94d-abe96664cdd0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:23.111788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 590/1177] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:27:22 2022] POST /identity/v3/users => generated 311 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:27:25.493290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ef3da-a1bd-4b42-b39c-99c12040177f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:25.493855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ef3da-a1bd-4b42-b39c-99c12040177f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:25.493950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ef3da-a1bd-4b42-b39c-99c12040177f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:25.495369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 588/1178] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:25.500959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91afe3d-2459-4113-9bd8-5ac9088cc01d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:25.501421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91afe3d-2459-4113-9bd8-5ac9088cc01d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:25.501536 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91afe3d-2459-4113-9bd8-5ac9088cc01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:25.508178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:25.519416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-c91afe3d-2459-4113-9bd8-5ac9088cc01d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:25.532517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c91afe3d-2459-4113-9bd8-5ac9088cc01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:25.596412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 591/1179] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:25.621607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ef3da-a1bd-4b42-b39c-99c12040177f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:25.661606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:25.741169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ef3da-a1bd-4b42-b39c-99c12040177f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:25.776455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194abb1b-9422-400c-9c36-b460821464e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:25.777253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194abb1b-9422-400c-9c36-b460821464e1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:25.777530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194abb1b-9422-400c-9c36-b460821464e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:25.777799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194abb1b-9422-400c-9c36-b460821464e1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:25.788520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194abb1b-9422-400c-9c36-b460821464e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-194abb1b-9422-400c-9c36-b460821464e1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:25.796151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:25.797309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:27:25.798217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 589/1180] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:27:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:25.804031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91afe3d-2459-4113-9bd8-5ac9088cc01d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:25.909161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91afe3d-2459-4113-9bd8-5ac9088cc01d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:25.955178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:25.955895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:25.956172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:25.956437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:25.957186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:25.957485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:25.958970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:25.960552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:25.968540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 592/1181] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:27:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:25.974655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194abb1b-9422-400c-9c36-b460821464e1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:26.070604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:26.085897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194abb1b-9422-400c-9c36-b460821464e1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:26.126965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd14662-f276-4f98-ad9b-a7b1dbb2d64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:26.127865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd14662-f276-4f98-ad9b-a7b1dbb2d64f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:26.128139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd14662-f276-4f98-ad9b-a7b1dbb2d64f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:26.128411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd14662-f276-4f98-ad9b-a7b1dbb2d64f None admin] PATH_INFO: `/v3/users/9ae94c543eed48af9151ddafd958205f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:26.143061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd14662-f276-4f98-ad9b-a7b1dbb2d64f None admin] RBAC: Authorizing `identity:get_user(user_id=9ae94c543eed48af9151ddafd958205f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:26.144777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd14662-f276-4f98-ad9b-a7b1dbb2d64f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:26.146743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 590/1182] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:27:25 2022] GET /identity/v3/users/9ae94c543eed48af9151ddafd958205f => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:26.152913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:26.262041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5358ca-b69e-4e9a-a11b-6e395da4c95f None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:26.300209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41c964-a408-4813-8364-67439c05d699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:26.300874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c964-a408-4813-8364-67439c05d699 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:26.301156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c964-a408-4813-8364-67439c05d699 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:26.301430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41c964-a408-4813-8364-67439c05d699 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:26.370795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:26.377810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41c964-a408-4813-8364-67439c05d699 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:26.383449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41c964-a408-4813-8364-67439c05d699 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:26.488197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 593/1183] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:27:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:26.494353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd14662-f276-4f98-ad9b-a7b1dbb2d64f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:26.601940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd14662-f276-4f98-ad9b-a7b1dbb2d64f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:26.637442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d0ea1-cdb4-4d7f-8f62-79e1d79e09f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:26.638311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0ea1-cdb4-4d7f-8f62-79e1d79e09f7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:26.638611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0ea1-cdb4-4d7f-8f62-79e1d79e09f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:26.638885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d0ea1-cdb4-4d7f-8f62-79e1d79e09f7 None admin] PATH_INFO: `/v3/projects/7433d8bd892c4e0b94e4a4f465adfd8e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:26.640073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d0ea1-cdb4-4d7f-8f62-79e1d79e09f7 None admin] RBAC: Authorizing `identity:get_project(project_id=7433d8bd892c4e0b94e4a4f465adfd8e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:26.641493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d0ea1-cdb4-4d7f-8f62-79e1d79e09f7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:26.643669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 591/1184] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:27:26 2022] GET /identity/v3/projects/7433d8bd892c4e0b94e4a4f465adfd8e => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:26.650592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41c964-a408-4813-8364-67439c05d699 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:26.753909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:26.761289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41c964-a408-4813-8364-67439c05d699 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:26.798141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa8505-f66d-4fbf-a6cb-e60bb0c2cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:26.798852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa8505-f66d-4fbf-a6cb-e60bb0c2cb15 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:26.799131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa8505-f66d-4fbf-a6cb-e60bb0c2cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:26.799403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa8505-f66d-4fbf-a6cb-e60bb0c2cb15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:26.800227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa8505-f66d-4fbf-a6cb-e60bb0c2cb15 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=7433d8bd892c4e0b94e4a4f465adfd8e, user.id=9ae94c543eed48af9151ddafd958205f) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:26.800535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa8505-f66d-4fbf-a6cb-e60bb0c2cb15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:26.801956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa8505-f66d-4fbf-a6cb-e60bb0c2cb15 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:26.808346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 594/1185] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:27:26 2022] GET /identity/v3/role_assignments?user.id=9ae94c543eed48af9151ddafd958205f&scope.project.id=7433d8bd892c4e0b94e4a4f465adfd8e&role.id=07de3e1931ca4d799df8510428e181aa => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:29.065618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d73c7f-dcd4-4015-8c62-701db23a5926 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.066160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d73c7f-dcd4-4015-8c62-701db23a5926 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.066160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d73c7f-dcd4-4015-8c62-701db23a5926 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.067569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 592/1186] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:29.073508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a832-8871-4f0d-b6d2-b8247204d33f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.073985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a832-8871-4f0d-b6d2-b8247204d33f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.074075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493a832-8871-4f0d-b6d2-b8247204d33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.091468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-d493a832-8871-4f0d-b6d2-b8247204d33f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:29.092760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d493a832-8871-4f0d-b6d2-b8247204d33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:29.163331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 595/1187] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:29.187279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d73c7f-dcd4-4015-8c62-701db23a5926 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:29.203055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:29.299865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d73c7f-dcd4-4015-8c62-701db23a5926 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:29.334839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4afd-1fd1-4e41-88b6-acf32a139394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:29.335620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4afd-1fd1-4e41-88b6-acf32a139394 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.335900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4afd-1fd1-4e41-88b6-acf32a139394 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.336171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5b4afd-1fd1-4e41-88b6-acf32a139394 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.346628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5b4afd-1fd1-4e41-88b6-acf32a139394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-5a5b4afd-1fd1-4e41-88b6-acf32a139394 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:29.354382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:29.355459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:27:29.356310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 593/1188] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:27:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:29.361959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493a832-8871-4f0d-b6d2-b8247204d33f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:29.460858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:29.470106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493a832-8871-4f0d-b6d2-b8247204d33f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:29.506539 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:29.507229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.507506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.507772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.508511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:29.508812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:29.510180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:29.519065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 596/1189] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:27:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:29.525167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4afd-1fd1-4e41-88b6-acf32a139394 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:29.596454 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:29.626678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5b4afd-1fd1-4e41-88b6-acf32a139394 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:29.661625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47175ab0-c441-4d39-9459-3678c922b6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:29.663181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175ab0-c441-4d39-9459-3678c922b6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.663455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175ab0-c441-4d39-9459-3678c922b6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.663725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47175ab0-c441-4d39-9459-3678c922b6a1 None admin] PATH_INFO: `/v3/users/9ae94c543eed48af9151ddafd958205f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.664922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47175ab0-c441-4d39-9459-3678c922b6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=9ae94c543eed48af9151ddafd958205f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:29.666351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47175ab0-c441-4d39-9459-3678c922b6a1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:29.668025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 594/1190] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:27:29 2022] GET /identity/v3/users/9ae94c543eed48af9151ddafd958205f => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:29.673833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:29.775853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e2325-53e0-47f4-a5c8-0d8a6f106f39 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:29.809811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c00a0d-fb7a-40c3-be55-c979bef6ea38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:29.810697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00a0d-fb7a-40c3-be55-c979bef6ea38 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.810975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00a0d-fb7a-40c3-be55-c979bef6ea38 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.811240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c00a0d-fb7a-40c3-be55-c979bef6ea38 None admin] PATH_INFO: `/v3/projects/7433d8bd892c4e0b94e4a4f465adfd8e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.812412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c00a0d-fb7a-40c3-be55-c979bef6ea38 None admin] RBAC: Authorizing `identity:get_project(project_id=7433d8bd892c4e0b94e4a4f465adfd8e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:29.813849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c00a0d-fb7a-40c3-be55-c979bef6ea38 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:29.815595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 597/1191] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:27:29 2022] GET /identity/v3/projects/7433d8bd892c4e0b94e4a4f465adfd8e => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:29.822483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47175ab0-c441-4d39-9459-3678c922b6a1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:29.923189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47175ab0-c441-4d39-9459-3678c922b6a1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:29.959683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3cb84-a358-4e4b-842e-0bf107d75364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:29.960588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3cb84-a358-4e4b-842e-0bf107d75364 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:29.960866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3cb84-a358-4e4b-842e-0bf107d75364 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:29.961132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3cb84-a358-4e4b-842e-0bf107d75364 None admin] PATH_INFO: `/v3/projects/7433d8bd892c4e0b94e4a4f465adfd8e/users/9ae94c543eed48af9151ddafd958205f/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:29.963214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3cb84-a358-4e4b-842e-0bf107d75364 None admin] RBAC: Authorizing `identity:create_grant(project_id=7433d8bd892c4e0b94e4a4f465adfd8e, user_id=9ae94c543eed48af9151ddafd958205f, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:29.964643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3cb84-a358-4e4b-842e-0bf107d75364 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:30.045383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:30.050135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 595/1192] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:27:29 2022] PUT /identity/v3/projects/7433d8bd892c4e0b94e4a4f465adfd8e/users/9ae94c543eed48af9151ddafd958205f/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:27:32.301101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f78a8-3298-417e-b66d-6f55aa41b9dd None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:32.301632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f78a8-3298-417e-b66d-6f55aa41b9dd None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:32.301632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f78a8-3298-417e-b66d-6f55aa41b9dd None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:32.303154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 598/1193] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:27:32.308719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23169-e0b4-446c-9321-3ed5f94ed962 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:32.309198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23169-e0b4-446c-9321-3ed5f94ed962 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:32.309291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c23169-e0b4-446c-9321-3ed5f94ed962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:32.326546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-94c23169-e0b4-446c-9321-3ed5f94ed962 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:27:32.327734 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-94c23169-e0b4-446c-9321-3ed5f94ed962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:27:32.399421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 596/1194] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:27:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:27:32.422987 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f78a8-3298-417e-b66d-6f55aa41b9dd None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:32.448798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:32.530792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f78a8-3298-417e-b66d-6f55aa41b9dd None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:32.564777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f700b-548b-46ef-a73a-148ea49a4914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:32.565566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f700b-548b-46ef-a73a-148ea49a4914 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:32.565841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f700b-548b-46ef-a73a-148ea49a4914 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:32.566107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f700b-548b-46ef-a73a-148ea49a4914 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:32.576956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f700b-548b-46ef-a73a-148ea49a4914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-0f7f700b-548b-46ef-a73a-148ea49a4914 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:27:32.584810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:27:32.585917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:27:32.587020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 599/1195] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:27:32.592059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c23169-e0b4-446c-9321-3ed5f94ed962 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:32.693776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c23169-e0b4-446c-9321-3ed5f94ed962 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:32.723115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:32.729231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:32.729975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:32.730248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:32.730517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:32.741937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:32.741937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:32.741937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:32.741937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 597/1196] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:32.747561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f700b-548b-46ef-a73a-148ea49a4914 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:32.837028 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:32.855965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f700b-548b-46ef-a73a-148ea49a4914 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:32.892016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be238548-1ce6-4dae-8be2-92d536adbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:32.892884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be238548-1ce6-4dae-8be2-92d536adbbec None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:32.893159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be238548-1ce6-4dae-8be2-92d536adbbec None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:32.893453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be238548-1ce6-4dae-8be2-92d536adbbec None admin] PATH_INFO: `/v3/users/9ae94c543eed48af9151ddafd958205f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:32.894922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be238548-1ce6-4dae-8be2-92d536adbbec None admin] RBAC: Authorizing `identity:get_user(user_id=9ae94c543eed48af9151ddafd958205f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:32.896908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be238548-1ce6-4dae-8be2-92d536adbbec None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:32.898787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 600/1197] 10.222.0.60 () {56 vars in 1177 bytes} [Thu May 26 12:27:32 2022] GET /identity/v3/users/9ae94c543eed48af9151ddafd958205f => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:27:32.904850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.008813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e7812-0b56-4b3e-b303-525104609517 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.047525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696d77-f43f-4ae4-88a9-0e1203e4322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.048187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696d77-f43f-4ae4-88a9-0e1203e4322c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.048467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696d77-f43f-4ae4-88a9-0e1203e4322c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.048745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24696d77-f43f-4ae4-88a9-0e1203e4322c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.111634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:33.121661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24696d77-f43f-4ae4-88a9-0e1203e4322c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:33.123150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24696d77-f43f-4ae4-88a9-0e1203e4322c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:33.224211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 598/1198] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:27:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:27:33.230895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be238548-1ce6-4dae-8be2-92d536adbbec None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.341311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be238548-1ce6-4dae-8be2-92d536adbbec None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.386361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98aa5f-1bb4-44c4-8044-9d09e2786154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.387264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98aa5f-1bb4-44c4-8044-9d09e2786154 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.387545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98aa5f-1bb4-44c4-8044-9d09e2786154 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.387820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98aa5f-1bb4-44c4-8044-9d09e2786154 None admin] PATH_INFO: `/v3/projects/7433d8bd892c4e0b94e4a4f465adfd8e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.389032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98aa5f-1bb4-44c4-8044-9d09e2786154 None admin] RBAC: Authorizing `identity:get_project(project_id=7433d8bd892c4e0b94e4a4f465adfd8e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:33.390449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98aa5f-1bb4-44c4-8044-9d09e2786154 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:33.392195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 601/1199] 10.222.0.60 () {56 vars in 1186 bytes} [Thu May 26 12:27:33 2022] GET /identity/v3/projects/7433d8bd892c4e0b94e4a4f465adfd8e => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:33.399629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696d77-f43f-4ae4-88a9-0e1203e4322c None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:27:33.493410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:33.502088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24696d77-f43f-4ae4-88a9-0e1203e4322c None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:27:33.540676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da294c-9cb8-4eb3-89fb-eac20b5c1bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:27:33.541336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da294c-9cb8-4eb3-89fb-eac20b5c1bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:27:33.541619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da294c-9cb8-4eb3-89fb-eac20b5c1bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:27:33.541896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da294c-9cb8-4eb3-89fb-eac20b5c1bd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:27:33.542755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da294c-9cb8-4eb3-89fb-eac20b5c1bd3 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=7433d8bd892c4e0b94e4a4f465adfd8e, user.id=9ae94c543eed48af9151ddafd958205f) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:27:33.543068 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da294c-9cb8-4eb3-89fb-eac20b5c1bd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:27:33.544523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da294c-9cb8-4eb3-89fb-eac20b5c1bd3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:27:33.550465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 599/1200] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:27:33 2022] GET /identity/v3/role_assignments?user.id=9ae94c543eed48af9151ddafd958205f&scope.project.id=7433d8bd892c4e0b94e4a4f465adfd8e&role.id=07de3e1931ca4d799df8510428e181aa => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:27:43.381953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:27:43.547864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=22 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:28:59.681738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a0d4-caed-42f5-88b5-40d185e24f2a None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:59.682373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a0d4-caed-42f5-88b5-40d185e24f2a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:59.682373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1a0d4-caed-42f5-88b5-40d185e24f2a None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:59.683802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 602/1201] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:28:59.690398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622c41-345e-4f0a-92dd-d7bcc569eefd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:59.690887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622c41-345e-4f0a-92dd-d7bcc569eefd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:59.690985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62622c41-345e-4f0a-92dd-d7bcc569eefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:59.708027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-62622c41-345e-4f0a-92dd-d7bcc569eefd None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:28:59.709214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-62622c41-345e-4f0a-92dd-d7bcc569eefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:28:59.790733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 600/1202] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:28:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:28:59.816114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1a0d4-caed-42f5-88b5-40d185e24f2a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:28:59.929057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1a0d4-caed-42f5-88b5-40d185e24f2a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:28:59.984627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:28:59.985362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:28:59.985639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:28:59.985910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:28:59.996405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:28:59.998409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:00.017233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:00.018494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:00.019555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:00.019555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:00.019555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:00.019555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:00.019555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 603/1203] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:00.025236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622c41-345e-4f0a-92dd-d7bcc569eefd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:00.132324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62622c41-345e-4f0a-92dd-d7bcc569eefd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:00.165536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:00.173444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086e37c-64b0-4f19-a351-9cd1107aabeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:00.174254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e37c-64b0-4f19-a351-9cd1107aabeb None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:00.174550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e37c-64b0-4f19-a351-9cd1107aabeb None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:00.174879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086e37c-64b0-4f19-a351-9cd1107aabeb None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:00.175662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086e37c-64b0-4f19-a351-9cd1107aabeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:00.175991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086e37c-64b0-4f19-a351-9cd1107aabeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:00.177409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086e37c-64b0-4f19-a351-9cd1107aabeb None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:00.191749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 601/1204] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:00.197879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:00.257655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:00.308655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e3ed3-5991-477f-971a-b9269c38729b None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:00.348746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab921ca-44f7-4a0b-85c7-a4676c19017a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:00.349414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab921ca-44f7-4a0b-85c7-a4676c19017a None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:00.349694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab921ca-44f7-4a0b-85c7-a4676c19017a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:00.349961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab921ca-44f7-4a0b-85c7-a4676c19017a None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:00.350698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab921ca-44f7-4a0b-85c7-a4676c19017a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:00.352119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab921ca-44f7-4a0b-85c7-a4676c19017a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:00.509002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 604/1205] 10.222.0.60 () {60 vars in 1132 bytes} [Thu May 26 12:29:00 2022] POST /identity/v3/users => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:29:02.835864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c66e4-75a8-4e93-aedf-1ddd95b13975 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:02.836425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c66e4-75a8-4e93-aedf-1ddd95b13975 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:02.836425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c66e4-75a8-4e93-aedf-1ddd95b13975 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:02.837793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 602/1206] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:02.844003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ce23-6db4-4c37-bb94-a35e37b33e80 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:02.844479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ce23-6db4-4c37-bb94-a35e37b33e80 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:02.844569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02ce23-6db4-4c37-bb94-a35e37b33e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:02.863046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-cc02ce23-6db4-4c37-bb94-a35e37b33e80 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:02.865445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cc02ce23-6db4-4c37-bb94-a35e37b33e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:02.954391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 605/1207] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:29:02.978038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c66e4-75a8-4e93-aedf-1ddd95b13975 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:03.088786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c66e4-75a8-4e93-aedf-1ddd95b13975 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:03.126709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63679d4b-6c6a-493d-98d8-91e108b8d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:03.141954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63679d4b-6c6a-493d-98d8-91e108b8d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:03.141954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63679d4b-6c6a-493d-98d8-91e108b8d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:03.141954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63679d4b-6c6a-493d-98d8-91e108b8d5e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:03.141954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63679d4b-6c6a-493d-98d8-91e108b8d5e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-63679d4b-6c6a-493d-98d8-91e108b8d5e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:29:03.149965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:03.151555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:03.152452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 603/1208] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:29:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:03.157379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02ce23-6db4-4c37-bb94-a35e37b33e80 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:03.208239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:03.291606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02ce23-6db4-4c37-bb94-a35e37b33e80 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:03.327929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:03.328594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:03.328869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:03.329134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:03.329878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:03.330166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:03.331555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:03.339565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 606/1209] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:29:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:03.345567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63679d4b-6c6a-493d-98d8-91e108b8d5e5 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:03.401757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:03.460463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63679d4b-6c6a-493d-98d8-91e108b8d5e5 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:03.501136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:03.501936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:03.502218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:03.502493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:03.513726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:03.515492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:03.534430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:03.536326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:03.537782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:03.537782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:03.537782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:03.537782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:03.537782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 604/1210] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:03.542261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:03.660116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:03.663567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda4e4f-a748-46df-a31e-45cf41b33ce8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:03.699654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:03.700315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:03.700592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:03.700972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:03.701823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:03.702128 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:03.703539 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:03.720664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 607/1211] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:03.726619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:03.832477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf36f6d-27b2-41ab-a6b0-b64492ef011f None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:03.834052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:03.867150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:03.867989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:03.868265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:03.868535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:03.875963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:03.877732 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:29:03.893357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:03.894660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:03.895893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 605/1212] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:03.900681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:04.015319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19719bcc-c171-40d3-9b6a-d5f29674490a None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:04.049785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:04.050497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:04.050799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:04.051070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:04.051950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:04.052252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:04.053684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:04.071892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 608/1213] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 26 12:29:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:04.078954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:04.208429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8311919-9f5b-4f14-951c-5792177e33f0 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:04.244628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7f47c-ae72-4efc-b9d3-526e85b73753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:04.256753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f47c-ae72-4efc-b9d3-526e85b73753 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:04.256753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f47c-ae72-4efc-b9d3-526e85b73753 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:04.256753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f7f47c-ae72-4efc-b9d3-526e85b73753 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:04.279246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:04.319826 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7f47c-ae72-4efc-b9d3-526e85b73753 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:04.325566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f7f47c-ae72-4efc-b9d3-526e85b73753 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:04.425542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 606/1214] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:29:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:29:04.431649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:04.450684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:04.537913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d211eb-776d-4a81-a06e-26d22a4fcbc8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:04.574783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:04.575606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:04.579724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:04.580022 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:04.594891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:04.596332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:04.614451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:04.618417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:04.619565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:04.619565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:04.619565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:04.619565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:04.619565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 609/1215] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:04.621553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7f47c-ae72-4efc-b9d3-526e85b73753 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:04.690411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:04.736142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f7f47c-ae72-4efc-b9d3-526e85b73753 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:04.772670 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:04.773367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:04.773646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:04.773920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:04.774666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:04.774971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:04.776368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:04.789181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 607/1216] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:04.795303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:04.868899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:04.901617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7dca61-e9bf-41e0-aaec-9aa90f74296b None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:04.945098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:04.945908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:04.946194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:04.946471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:04.954235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:04.955717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:29:04.969686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:04.970942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:04.972204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 610/1217] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:04.977017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:05.081224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650e5590-b434-405a-8fa1-be30270817e6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:05.104127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:05.116902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8257210-8feb-4e04-8814-8fb0e976446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:05.117566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257210-8feb-4e04-8814-8fb0e976446b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:05.117943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257210-8feb-4e04-8814-8fb0e976446b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:05.118220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8257210-8feb-4e04-8814-8fb0e976446b None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:05.119033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257210-8feb-4e04-8814-8fb0e976446b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:05.119341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257210-8feb-4e04-8814-8fb0e976446b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:05.120758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8257210-8feb-4e04-8814-8fb0e976446b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:05.133582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 608/1218] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:05.140748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:05.251619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd43d5-0143-4481-8eeb-c0d9ad85d4aa None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:05.282070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:05.288134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832e5c8-516b-4787-8e51-04afeacdf7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:05.288891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e5c8-516b-4787-8e51-04afeacdf7fc None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:05.289188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e5c8-516b-4787-8e51-04afeacdf7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:05.289464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e5c8-516b-4787-8e51-04afeacdf7fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:05.290347 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832e5c8-516b-4787-8e51-04afeacdf7fc None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=15d6aefae65c4c54b16d22c6f652dcbf) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:05.290696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832e5c8-516b-4787-8e51-04afeacdf7fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:05.292124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832e5c8-516b-4787-8e51-04afeacdf7fc None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:05.298643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 611/1219] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:29:05 2022] GET /identity/v3/role_assignments?user.id=15d6aefae65c4c54b16d22c6f652dcbf&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:07.574599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd36383-7cde-416b-aff5-663d174b61b6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:07.575108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd36383-7cde-416b-aff5-663d174b61b6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:07.575108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd36383-7cde-416b-aff5-663d174b61b6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:07.577034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 609/1220] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:07.582918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431ee7-fbbe-4425-b413-007d7249968f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:07.583424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431ee7-fbbe-4425-b413-007d7249968f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:07.583548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd431ee7-fbbe-4425-b413-007d7249968f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:07.602428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-dd431ee7-fbbe-4425-b413-007d7249968f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:07.603688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-dd431ee7-fbbe-4425-b413-007d7249968f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:07.679689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 612/1221] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:29:07.703554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd36383-7cde-416b-aff5-663d174b61b6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:07.818010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd36383-7cde-416b-aff5-663d174b61b6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:07.860169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3431-08cf-4d03-8ffd-6426e68fa56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:07.860875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3431-08cf-4d03-8ffd-6426e68fa56a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:07.861157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3431-08cf-4d03-8ffd-6426e68fa56a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:07.861433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b3431-08cf-4d03-8ffd-6426e68fa56a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:07.878291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b3431-08cf-4d03-8ffd-6426e68fa56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4f6b3431-08cf-4d03-8ffd-6426e68fa56a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:29:07.886176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:07.887373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:07.888532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 610/1222] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:29:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:07.893980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd431ee7-fbbe-4425-b413-007d7249968f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:07.999578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd431ee7-fbbe-4425-b413-007d7249968f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:08.031244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:08.046186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:08.046952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:08.047237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:08.047514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:08.048261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:08.048571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:08.049947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:08.058519 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 613/1223] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:29:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:29:08.065129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3431-08cf-4d03-8ffd-6426e68fa56a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:08.116508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:08.176131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b3431-08cf-4d03-8ffd-6426e68fa56a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:08.211737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:08.212534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:08.212810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:08.213080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:08.224595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:08.226039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:08.244623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:08.245722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:08.247057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:08.247057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:08.247057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:08.247057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:08.247057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 611/1224] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:08.252109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:08.360302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75d2f0-25be-45bc-9203-72b555b1e1f1 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:08.402036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee794263-c240-4281-b726-94072bd254fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:08.402767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee794263-c240-4281-b726-94072bd254fb None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:08.403050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee794263-c240-4281-b726-94072bd254fb None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:08.405025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee794263-c240-4281-b726-94072bd254fb None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:08.405025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee794263-c240-4281-b726-94072bd254fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:08.405025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee794263-c240-4281-b726-94072bd254fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:08.406413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee794263-c240-4281-b726-94072bd254fb None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:08.420911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 614/1225] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:29:08.428132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:08.540409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:08.547678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325ead64-15d8-45c1-a89c-b0c62ded83a1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:08.583209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:08.584012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:08.584291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:08.584563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:08.592795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:08.594476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:29:08.611944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:08.613169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:08.614163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 612/1226] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:08.619678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee794263-c240-4281-b726-94072bd254fb None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:08.674307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:08.746282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee794263-c240-4281-b726-94072bd254fb None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:08.792209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:08.792878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:08.793200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:08.793471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:08.794333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:08.794695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:08.796145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:08.815322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 615/1227] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 26 12:29:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:08.821295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:08.934447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2015c7e4-cc2f-4f48-8630-d71e0bc60af1 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:08.976016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:08.976818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:08.977097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:08.977374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:08.987717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:08.989180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:09.007221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:09.008328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:09.009416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:09.009416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:09.009416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:09.009416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:09.009416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 613/1228] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:09.015054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:09.118849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e8c62-eb8b-466e-b7e4-3776b8607f5c None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:09.121983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:09.159503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:09.160174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:09.160450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:09.160718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:09.161427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:09.161729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:09.163119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:09.176749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 616/1229] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:09.183448 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:09.193383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:09.293921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a11c3b-4701-4052-9dd8-b56fc8430475 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:09.328436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:09.329242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:09.329523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:09.329792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:09.336831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:09.338266 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:29:09.354368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:09.355547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:09.356897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 614/1230] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:29:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:29:09.362206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:09.468558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ecf235-3f51-4bf3-905d-ddc17211b1b0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:09.502701 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c072a24-4186-426f-94fd-5355597d3d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:09.503522 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072a24-4186-426f-94fd-5355597d3d18 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:09.503811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072a24-4186-426f-94fd-5355597d3d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:09.504089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072a24-4186-426f-94fd-5355597d3d18 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:09.504878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c072a24-4186-426f-94fd-5355597d3d18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:09.505187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c072a24-4186-426f-94fd-5355597d3d18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:09.506649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c072a24-4186-426f-94fd-5355597d3d18 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:09.520048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 617/1231] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:29:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:09.526626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:09.599096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:09.633733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cb469-57bf-4962-a347-6f5619022601 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:09.668633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540835ba-d1cd-4f8d-8df5-0f9e79e538a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:09.669530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540835ba-d1cd-4f8d-8df5-0f9e79e538a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:09.669994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540835ba-d1cd-4f8d-8df5-0f9e79e538a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:09.670766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540835ba-d1cd-4f8d-8df5-0f9e79e538a7 None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/15d6aefae65c4c54b16d22c6f652dcbf/roles/d1ec8d970c824de78ea63e57d8720241` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:09.689422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540835ba-d1cd-4f8d-8df5-0f9e79e538a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=15d6aefae65c4c54b16d22c6f652dcbf, role_id=d1ec8d970c824de78ea63e57d8720241)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:09.691041 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540835ba-d1cd-4f8d-8df5-0f9e79e538a7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:09.835632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 615/1232] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:29:09 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/15d6aefae65c4c54b16d22c6f652dcbf/roles/d1ec8d970c824de78ea63e57d8720241 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:29:12.093257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651d18-1b83-41f4-9902-25684b2a1397 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:12.093824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651d18-1b83-41f4-9902-25684b2a1397 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:12.093824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef651d18-1b83-41f4-9902-25684b2a1397 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:12.095244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 618/1233] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:12.100692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b6ffc-d55b-4260-871d-0dec5b13c6ac None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:12.101158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b6ffc-d55b-4260-871d-0dec5b13c6ac None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:12.101247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b6ffc-d55b-4260-871d-0dec5b13c6ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:12.118815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-511b6ffc-d55b-4260-871d-0dec5b13c6ac None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:12.120035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-511b6ffc-d55b-4260-871d-0dec5b13c6ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:12.191168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 616/1234] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:29:12.216072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651d18-1b83-41f4-9902-25684b2a1397 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:12.242405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:12.324873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef651d18-1b83-41f4-9902-25684b2a1397 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:12.361498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8314b-f3b7-4880-b9a6-1660cf0c3078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:12.362212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8314b-f3b7-4880-b9a6-1660cf0c3078 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:12.362483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8314b-f3b7-4880-b9a6-1660cf0c3078 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:12.362780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8314b-f3b7-4880-b9a6-1660cf0c3078 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:12.373783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8314b-f3b7-4880-b9a6-1660cf0c3078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-2ad8314b-f3b7-4880-b9a6-1660cf0c3078 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:29:12.381643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:12.382844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:12.384061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 619/1235] 10.222.0.60 () {56 vars in 1102 bytes} [Thu May 26 12:29:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:12.389356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b6ffc-d55b-4260-871d-0dec5b13c6ac None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:12.440585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:12.498815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b6ffc-d55b-4260-871d-0dec5b13c6ac None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:12.533308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:12.533977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:12.534253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:12.534548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:12.535289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:12.535586 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:12.536996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:12.546416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 617/1236] 10.222.0.60 () {56 vars in 1103 bytes} [Thu May 26 12:29:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:12.552260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8314b-f3b7-4880-b9a6-1660cf0c3078 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:12.639054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:12.655804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8314b-f3b7-4880-b9a6-1660cf0c3078 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:12.690178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:12.691034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:12.691310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:12.691574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:12.701621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:12.703311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:12.722706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:12.723815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:12.724765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:12.724765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:12.724765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:12.724765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:12.724765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 620/1237] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:12.729719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:12.837901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c7c9c-3316-4d46-8415-e67ab94bdd68 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:12.847792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:12.875193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:12.876166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:12.876166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:12.876446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:12.877161 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:12.877467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:12.878838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:12.892790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 618/1238] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:12.898696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:13.004404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ae2b9-f024-45f6-9d2a-d6dfc292b514 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:13.040123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:13.040925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:13.041199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:13.041466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:13.044234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:13.049011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:13.050433 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:29:13.065015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:13.066248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:13.067331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 621/1239] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:13.072125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:13.180785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03ecc19-4a4f-4fce-acd5-2b7a3a815d5d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:13.220154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:13.220832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:13.221115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:13.221393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:13.222231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:13.222561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:13.223988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:13.242772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 619/1240] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 26 12:29:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:13.249293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:13.369626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9528d61-ff77-45fd-9f10-87daf5eefff8 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:13.427190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54693d2a-244c-4ca2-bd21-4cb248d7aaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:13.427855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54693d2a-244c-4ca2-bd21-4cb248d7aaa0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:13.428133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54693d2a-244c-4ca2-bd21-4cb248d7aaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:13.428403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54693d2a-244c-4ca2-bd21-4cb248d7aaa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:13.492358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:13.499999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54693d2a-244c-4ca2-bd21-4cb248d7aaa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:13.501465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54693d2a-244c-4ca2-bd21-4cb248d7aaa0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:13.604283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 622/1241] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:29:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:29:13.611580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:13.638437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:13.720033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a241c-ae87-4248-bbee-8dde99b33b42 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:13.755105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:13.755818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:13.756082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:13.756354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:13.767144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:13.768588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:13.789116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:13.790735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:13.792385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:13.792385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:13.792385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:13.792385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:13.792385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 620/1242] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:13.796257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54693d2a-244c-4ca2-bd21-4cb248d7aaa0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:13.902321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:13.908838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54693d2a-244c-4ca2-bd21-4cb248d7aaa0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:13.948810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:13.949524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:13.949773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:13.950045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:13.950858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:13.951806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:13.953330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:13.965187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 623/1243] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:13.971405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:14.054358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:14.078985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03d17d-e433-4ccc-a0d3-6b9707702543 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:14.115086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:14.115900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:14.116180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:14.116449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:14.124709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:14.126230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:29:14.141496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:14.142638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:14.143555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 621/1244] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:14.149173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:14.250950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d204-fbee-45c6-a9f3-af19efbae3d7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:14.288929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08382ef1-2594-4e08-a430-128da3c127b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:14.289605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08382ef1-2594-4e08-a430-128da3c127b7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:14.289890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08382ef1-2594-4e08-a430-128da3c127b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:14.290167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08382ef1-2594-4e08-a430-128da3c127b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:14.290995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08382ef1-2594-4e08-a430-128da3c127b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:14.291379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08382ef1-2594-4e08-a430-128da3c127b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:14.292783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08382ef1-2594-4e08-a430-128da3c127b7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:14.305860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 624/1245] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:14.312809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:14.415149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9f035-6b83-45de-983e-8b488d1b0619 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:14.452552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ece05-5640-4bcf-bb4e-687ad63bbc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:14.453226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ece05-5640-4bcf-bb4e-687ad63bbc1f None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:14.453513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ece05-5640-4bcf-bb4e-687ad63bbc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:14.453789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ece05-5640-4bcf-bb4e-687ad63bbc1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:14.454659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ece05-5640-4bcf-bb4e-687ad63bbc1f None admin] RBAC: Adding query filter params (role.id=d1ec8d970c824de78ea63e57d8720241, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=15d6aefae65c4c54b16d22c6f652dcbf) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:14.454967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ece05-5640-4bcf-bb4e-687ad63bbc1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:14.456404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ece05-5640-4bcf-bb4e-687ad63bbc1f None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:14.462696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 622/1246] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:29:14 2022] GET /identity/v3/role_assignments?user.id=15d6aefae65c4c54b16d22c6f652dcbf&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=d1ec8d970c824de78ea63e57d8720241 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:16.754910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af34ae-1650-468e-a182-0b74a70add75 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:16.755478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af34ae-1650-468e-a182-0b74a70add75 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:16.755620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af34ae-1650-468e-a182-0b74a70add75 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:16.757143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 625/1247] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:16.762936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe4fc-b7ae-4a97-a914-e4dc78a7ea87 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:16.763404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe4fc-b7ae-4a97-a914-e4dc78a7ea87 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:16.763496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fe4fc-b7ae-4a97-a914-e4dc78a7ea87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:16.769736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:16.783517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3b8fe4fc-b7ae-4a97-a914-e4dc78a7ea87 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:16.784971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3b8fe4fc-b7ae-4a97-a914-e4dc78a7ea87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:16.858400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 623/1248] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:29:16.882392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af34ae-1650-468e-a182-0b74a70add75 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:16.903163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:17.035898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af34ae-1650-468e-a182-0b74a70add75 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:17.074316 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8717e8-8ed4-4e4d-8a51-40b4f25719ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:17.075134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8717e8-8ed4-4e4d-8a51-40b4f25719ab None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:17.075414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8717e8-8ed4-4e4d-8a51-40b4f25719ab None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:17.075691 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8717e8-8ed4-4e4d-8a51-40b4f25719ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:17.091569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8717e8-8ed4-4e4d-8a51-40b4f25719ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-1b8717e8-8ed4-4e4d-8a51-40b4f25719ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:29:17.099542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:17.100749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:17.101883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 626/1249] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:29:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:17.107969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fe4fc-b7ae-4a97-a914-e4dc78a7ea87 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:17.222461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fe4fc-b7ae-4a97-a914-e4dc78a7ea87 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:17.253118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:17.257887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:17.258592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:17.258876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:17.259155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:17.259907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:17.260213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:17.261581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:17.271259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 624/1250] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:29:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:17.277393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8717e8-8ed4-4e4d-8a51-40b4f25719ab None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:17.360777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:17.384495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8717e8-8ed4-4e4d-8a51-40b4f25719ab None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:17.423012 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:17.423812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:17.424110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:17.424376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:17.436607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:17.438071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:17.455802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:17.457090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:17.458030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:17.458030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:17.458030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:17.458030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:17.458030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 627/1251] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:17.462978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:17.567329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc082f7-856a-476c-9178-fe979dd87d37 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:17.603150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:17.603813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:17.604090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:17.604361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:17.605076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:17.605462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:17.606845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:17.619238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 625/1252] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:17.625773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:17.732000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339893b-3512-4beb-b9d6-e9c572bb8173 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:17.760037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:17.768237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:17.769377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:17.769861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:17.770210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:17.780427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:17.781892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:29:17.797213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:17.798385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:17.799582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 628/1253] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:17.804540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:17.861132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:17.906259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104052f0-bec2-4c44-9b05-4a830a3f303e None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:17.940734 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:17.941382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:17.941659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:17.942003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:17.942861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:17.943168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:17.944581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:17.962750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 626/1254] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 26 12:29:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:17.969594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:18.069877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0b4d-9dde-41f4-b91e-52e7b4029d97 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:18.105662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39819d-1093-433c-9b87-fc5f14052a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:18.106313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39819d-1093-433c-9b87-fc5f14052a59 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:18.106619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39819d-1093-433c-9b87-fc5f14052a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:18.106890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39819d-1093-433c-9b87-fc5f14052a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:18.164674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:18.177129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39819d-1093-433c-9b87-fc5f14052a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:18.178590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39819d-1093-433c-9b87-fc5f14052a59 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:18.285047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 629/1255] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:29:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:29:18.290923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:18.398870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84ddcd-98db-4064-8dae-3d3762290ad7 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:18.422783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:18.437451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:18.438261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:18.438559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:18.438839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:18.449553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:18.454820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:18.472990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:18.478809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:18.480554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:18.480554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:18.480554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:18.480554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:18.480554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 627/1256] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:18.482845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39819d-1093-433c-9b87-fc5f14052a59 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:18.585819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:18.598284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39819d-1093-433c-9b87-fc5f14052a59 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:18.632824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:18.633495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:18.633782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:18.634054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:18.634808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:18.635117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:18.636484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:18.649300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 630/1257] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:18.655124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:18.761485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c14c1b-25a2-4ea5-b9d0-fbd871657850 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:18.809183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:18.809984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:18.810261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:18.810559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:18.818493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:18.819958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:29:18.836669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:18.837860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:18.839562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 628/1258] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:18.845971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:18.947612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f320f5fd-f04b-4837-8d8c-676a150ba4d7 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:18.980146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea6900e-2036-4e1b-b602-3385f0729a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:18.980894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6900e-2036-4e1b-b602-3385f0729a29 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:18.981171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6900e-2036-4e1b-b602-3385f0729a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:18.981441 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea6900e-2036-4e1b-b602-3385f0729a29 None admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:18.982213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6900e-2036-4e1b-b602-3385f0729a29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:18.983043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6900e-2036-4e1b-b602-3385f0729a29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:18.984638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea6900e-2036-4e1b-b602-3385f0729a29 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:18.997111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 631/1259] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:19.004072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:19.032266 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:19.108311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae60c501-71c0-4796-9fb7-b254bab606b9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:19.143504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0afc5-045c-4f59-beb9-c616a81004c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:19.144180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0afc5-045c-4f59-beb9-c616a81004c3 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:19.144462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0afc5-045c-4f59-beb9-c616a81004c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:19.144736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0afc5-045c-4f59-beb9-c616a81004c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:19.145580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0afc5-045c-4f59-beb9-c616a81004c3 None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=15d6aefae65c4c54b16d22c6f652dcbf) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:19.145893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0afc5-045c-4f59-beb9-c616a81004c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:19.147691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0afc5-045c-4f59-beb9-c616a81004c3 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:19.157665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 629/1260] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:29:19 2022] GET /identity/v3/role_assignments?user.id=15d6aefae65c4c54b16d22c6f652dcbf&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=07de3e1931ca4d799df8510428e181aa => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:21.392556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081c08-7352-4cba-9f79-4159de36adfd None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.393109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081c08-7352-4cba-9f79-4159de36adfd None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.393109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d081c08-7352-4cba-9f79-4159de36adfd None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:21.394438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 632/1261] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:21.399986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849262e-52c4-4c43-8709-9f9e2c395f97 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.400412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849262e-52c4-4c43-8709-9f9e2c395f97 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.400552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849262e-52c4-4c43-8709-9f9e2c395f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:21.417651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3849262e-52c4-4c43-8709-9f9e2c395f97 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:21.418882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3849262e-52c4-4c43-8709-9f9e2c395f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:21.487579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 630/1262] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:29:21.510267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d081c08-7352-4cba-9f79-4159de36adfd None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:21.522719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:21.618072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d081c08-7352-4cba-9f79-4159de36adfd None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:21.653083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84e938-b4b2-4095-8242-e4f3262a1cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:21.653876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e938-b4b2-4095-8242-e4f3262a1cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.654153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e938-b4b2-4095-8242-e4f3262a1cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.654421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e938-b4b2-4095-8242-e4f3262a1cc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:21.665099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84e938-b4b2-4095-8242-e4f3262a1cc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-2d84e938-b4b2-4095-8242-e4f3262a1cc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:29:21.672917 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:21.674037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:21.675308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 633/1263] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:29:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:21.680260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849262e-52c4-4c43-8709-9f9e2c395f97 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:21.699038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:21.780027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849262e-52c4-4c43-8709-9f9e2c395f97 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:21.815410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:21.816128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.816391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.816716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:21.817459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:21.817763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:21.819161 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:21.827476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 631/1264] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:29:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:21.833384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84e938-b4b2-4095-8242-e4f3262a1cc5 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:21.901751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:21.939068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84e938-b4b2-4095-8242-e4f3262a1cc5 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:21.972131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:21.972927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:21.973204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:21.973473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:21.984754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:21.986206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:22.004032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:22.005802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:22.006836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:22.006836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:22.006836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:22.006836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:22.006836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 634/1265] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:29:22.011875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:22.097324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:22.116744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e200d4-77b2-459d-ada3-5e1966c9de65 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:22.151002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:22.151655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:22.151978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:22.152198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:22.152898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:22.153195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:22.154738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:22.165536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 632/1266] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:22.172403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:22.273959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0251d59-0bed-4904-9be4-daf17c0fcda0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:22.294541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:22.308632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:22.309431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:22.309706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:22.309973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:22.317352 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:22.318804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:29:22.333029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:22.334154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:22.335380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 635/1267] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:29:22.340225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:22.445182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9af330b-de94-4245-94ad-5167e7ecdaf9 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:22.479223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:22.479896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:22.480168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:22.480436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:22.481383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:22.481688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:22.483234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:22.493075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:22.501969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 633/1268] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 26 12:29:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:22.507643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:22.613324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405146-af55-48d2-8843-11b0ef712378 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:22.653862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:22.655198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:22.655572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:22.656010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:22.671178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:22.673869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:22.694657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:22.695846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:22.702575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:22.702575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:22.702575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:22.702575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:22.702575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 636/1269] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:22.702952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:22.809125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a68b1-b907-401e-bf08-3536524e8fbe None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:22.844780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:22.845440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:22.845725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:22.845990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:22.846731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:22.847031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:22.848384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:22.861154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 634/1270] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:22.867286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:22.901110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:22.973758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96fb33-3eb6-4993-abe0-bd7bf18737f9 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:23.009010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:23.009815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:23.010093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:23.010362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:23.017766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:23.019249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:29:23.034750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:23.035850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:23.036882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 637/1271] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:29:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:23.042090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:23.103175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:23.144510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc1030-b1e3-4671-9784-67bb510b2e6a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:23.178161 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07e354-be47-4140-aedb-e9157a8448fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:23.178856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07e354-be47-4140-aedb-e9157a8448fa None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:23.179166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07e354-be47-4140-aedb-e9157a8448fa None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:23.179406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07e354-be47-4140-aedb-e9157a8448fa None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:23.180184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07e354-be47-4140-aedb-e9157a8448fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:23.180487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07e354-be47-4140-aedb-e9157a8448fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:23.181900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07e354-be47-4140-aedb-e9157a8448fa None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:23.194658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 635/1272] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:29:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:23.200654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:23.298663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:23.307100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973dcda-f41e-40bf-b1f1-1a1aa970fab1 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:23.343377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c11f582-b590-4156-b45e-b51f3bdee35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:23.344284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11f582-b590-4156-b45e-b51f3bdee35a None admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:23.344561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11f582-b590-4156-b45e-b51f3bdee35a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:23.344832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c11f582-b590-4156-b45e-b51f3bdee35a None admin] PATH_INFO: `/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/15d6aefae65c4c54b16d22c6f652dcbf/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:23.346901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11f582-b590-4156-b45e-b51f3bdee35a None admin] RBAC: Authorizing `identity:create_grant(project_id=f5dd2a2460594ca5b136d9ca5e5eabbc, user_id=15d6aefae65c4c54b16d22c6f652dcbf, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:23.348428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c11f582-b590-4156-b45e-b51f3bdee35a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:23.522178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 638/1273] 10.222.0.60 () {58 vars in 1439 bytes} [Thu May 26 12:29:23 2022] PUT /identity/v3/projects/f5dd2a2460594ca5b136d9ca5e5eabbc/users/15d6aefae65c4c54b16d22c6f652dcbf/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:29:25.778774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92ee2-10c5-44ed-880e-84937628d8aa None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:25.779395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92ee2-10c5-44ed-880e-84937628d8aa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:25.779395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f92ee2-10c5-44ed-880e-84937628d8aa None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:25.781077 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 636/1274] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:25.786538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc8da-8cff-49b0-a9ae-b4261ab85681 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:25.786994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc8da-8cff-49b0-a9ae-b4261ab85681 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:25.787134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddc8da-8cff-49b0-a9ae-b4261ab85681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:25.804859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7bddc8da-8cff-49b0-a9ae-b4261ab85681 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:25.809589 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7bddc8da-8cff-49b0-a9ae-b4261ab85681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:25.873214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 639/1275] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:29:25.897308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92ee2-10c5-44ed-880e-84937628d8aa None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:26.000711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f92ee2-10c5-44ed-880e-84937628d8aa None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:26.018505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:26.036408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f75c9d-b291-479b-8756-ab44c6c70edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:26.037134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f75c9d-b291-479b-8756-ab44c6c70edd None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:26.037414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f75c9d-b291-479b-8756-ab44c6c70edd None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:26.037686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f75c9d-b291-479b-8756-ab44c6c70edd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:26.049467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f75c9d-b291-479b-8756-ab44c6c70edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-64f75c9d-b291-479b-8756-ab44c6c70edd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 12:29:26.057144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:26.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:26.059404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 637/1276] 10.222.0.60 () {56 vars in 1096 bytes} [Thu May 26 12:29:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:26.064766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddc8da-8cff-49b0-a9ae-b4261ab85681 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:26.149812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:26.167525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddc8da-8cff-49b0-a9ae-b4261ab85681 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:26.200135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:26.200821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:26.201095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:26.201367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:26.202210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:26.202507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:26.203878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:26.211611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 640/1277] 10.222.0.60 () {56 vars in 1099 bytes} [Thu May 26 12:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:26.218186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f75c9d-b291-479b-8756-ab44c6c70edd None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:26.321590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f75c9d-b291-479b-8756-ab44c6c70edd None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:26.356975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:26.357816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:26.358111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:26.358387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:26.369768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:26.371254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:26.389920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:26.391234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:26.393095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:26.393095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:26.393095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:26.393095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:26.393095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 638/1278] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:26.398637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:26.503118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86da67-4a18-4344-bea1-8089e792dcb6 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:26.537925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:26.540902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:26.540902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:26.540902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:26.540902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:26.540902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:26.541690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:26.555306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 641/1279] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:26.561778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:26.593887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:26.675023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e0f4-537d-4c42-ba10-09a3bd52060d None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:26.720337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:26.721180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:26.721458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:26.721725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:26.729132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:26.730599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 12:29:26.746473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:26.747952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:26.749480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 639/1280] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:26.754049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:26.757978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:26.861122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e05d42-dd7f-4921-a4ae-82a55e125d9d None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:26.901394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:26.902064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:26.902341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:26.902639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:26.903467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:26.903771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:26.906167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:26.929522 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 642/1281] 10.222.0.60 () {56 vars in 1143 bytes} [Thu May 26 12:29:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:26.935628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:27.032023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:27.056092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec6c64b-12d6-48c6-83e3-38742bc0a606 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:27.091362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7c20b-7c0e-4d47-b19a-56b678dfdb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:27.092052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7c20b-7c0e-4d47-b19a-56b678dfdb16 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:27.093061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7c20b-7c0e-4d47-b19a-56b678dfdb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:27.093445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7c20b-7c0e-4d47-b19a-56b678dfdb16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:27.164630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7c20b-7c0e-4d47-b19a-56b678dfdb16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:27.166128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7c20b-7c0e-4d47-b19a-56b678dfdb16 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:27.253879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:27.265617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 640/1282] 10.222.0.60 () {58 vars in 1282 bytes} [Thu May 26 12:29:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 12:29:27.271419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:27.333331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:27.371191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1326-156d-4e09-ae63-b568e36e73c3 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:27.404694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:27.406157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:27.406439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:27.406738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:27.428131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:27.428131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 12:29:27.437002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:27.438706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:27.439693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 12:29:27.439693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 12:29:27.439693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 12:29:27.439693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:27.439693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 643/1283] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:27.444048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7c20b-7c0e-4d47-b19a-56b678dfdb16 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:27.545132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7c20b-7c0e-4d47-b19a-56b678dfdb16 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:27.580408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:27.581075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:27.581353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:27.581622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:27.582332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:27.582665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:27.584014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:27.595319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 641/1284] 10.222.0.60 () {56 vars in 1109 bytes} [Thu May 26 12:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:27.601029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:27.701390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa790973-cfc2-467f-9a17-a3516e83c1a0 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:27.715893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:27.737477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:27.738281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:27.738586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:27.738862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:27.746063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:27.747521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 12:29:27.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application with Lock( May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:27.765286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:27.766190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 12:29:27.766190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 12:29:27.766190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 12:29:27.766190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 12:29:27.766190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 12:29:27.766190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 12:29:27.766190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 12:29:27.766190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: ERROR keystone.server.flask.application May 26 12:29:27.772249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 644/1285] 10.222.0.60 () {56 vars in 1111 bytes} [Thu May 26 12:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:27.772399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:27.826175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:27.875450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a2baf-f2e3-49ac-bbbc-3329178e8b0a None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:27.908117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47120-9a17-41d6-bde4-c9cbd73740f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:27.908787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47120-9a17-41d6-bde4-c9cbd73740f1 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:27.909073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47120-9a17-41d6-bde4-c9cbd73740f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:27.909565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47120-9a17-41d6-bde4-c9cbd73740f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:27.910541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47120-9a17-41d6-bde4-c9cbd73740f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:27.910853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47120-9a17-41d6-bde4-c9cbd73740f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:27.912960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47120-9a17-41d6-bde4-c9cbd73740f1 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:27.925745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 642/1286] 10.222.0.60 () {56 vars in 1148 bytes} [Thu May 26 12:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:27.931843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:28.033533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60719212-b1fb-4ade-a110-ba472dcae816 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:28.068958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed665f69-a55c-4cab-b530-9647298d248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:28.069612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665f69-a55c-4cab-b530-9647298d248a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:28.069889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665f69-a55c-4cab-b530-9647298d248a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:28.070160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed665f69-a55c-4cab-b530-9647298d248a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:28.071015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665f69-a55c-4cab-b530-9647298d248a None admin] RBAC: Adding query filter params (role.id=07de3e1931ca4d799df8510428e181aa, scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc, user.id=15d6aefae65c4c54b16d22c6f652dcbf) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:28.071324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665f69-a55c-4cab-b530-9647298d248a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:28.072739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed665f69-a55c-4cab-b530-9647298d248a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:28.078768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 645/1287] 10.222.0.60 () {56 vars in 1374 bytes} [Thu May 26 12:29:27 2022] GET /identity/v3/role_assignments?user.id=15d6aefae65c4c54b16d22c6f652dcbf&scope.project.id=f5dd2a2460594ca5b136d9ca5e5eabbc&role.id=07de3e1931ca4d799df8510428e181aa => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:30.362430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91c351-7e48-4d18-8737-2d8d75a4fc1d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:30.363014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91c351-7e48-4d18-8737-2d8d75a4fc1d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:30.363014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91c351-7e48-4d18-8737-2d8d75a4fc1d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:30.364387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 643/1288] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:30.369722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfdfab-c494-4d47-ac01-a4cf3205c657 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:30.370158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfdfab-c494-4d47-ac01-a4cf3205c657 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:30.370265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bfdfab-c494-4d47-ac01-a4cf3205c657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:30.387176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-33bfdfab-c494-4d47-ac01-a4cf3205c657 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:30.388384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-33bfdfab-c494-4d47-ac01-a4cf3205c657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:30.420491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:30.462095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 646/1289] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:29:30.484995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91c351-7e48-4d18-8737-2d8d75a4fc1d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:30.589924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91c351-7e48-4d18-8737-2d8d75a4fc1d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:30.602091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:30.628398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:30.629208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:30.640945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:30.641217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:30.641904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:30.643344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:30.664660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:30.667132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:30.668516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 644/1290] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:29:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 12:29:30.674317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfdfab-c494-4d47-ac01-a4cf3205c657 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:30.784836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bfdfab-c494-4d47-ac01-a4cf3205c657 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:30.819331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23184b-b769-4f49-b6ff-0d08a7b98540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:30.819999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23184b-b769-4f49-b6ff-0d08a7b98540 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:30.820282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23184b-b769-4f49-b6ff-0d08a7b98540 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:30.820554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23184b-b769-4f49-b6ff-0d08a7b98540 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:30.821253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23184b-b769-4f49-b6ff-0d08a7b98540 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:30.821556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23184b-b769-4f49-b6ff-0d08a7b98540 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:30.822957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23184b-b769-4f49-b6ff-0d08a7b98540 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:30.828384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 647/1291] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 26 12:29:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:30.834295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:30.943115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9fc55-60d1-407d-bd57-35c3fb2cd6b6 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:30.977206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d081c-ecef-4e1b-a3a0-344da546be30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:30.977882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d081c-ecef-4e1b-a3a0-344da546be30 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:30.978162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d081c-ecef-4e1b-a3a0-344da546be30 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:30.978436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d081c-ecef-4e1b-a3a0-344da546be30 None admin] PATH_INFO: `/v3/services` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:30.979171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d081c-ecef-4e1b-a3a0-344da546be30 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:30.979556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d081c-ecef-4e1b-a3a0-344da546be30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:30.983749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d081c-ecef-4e1b-a3a0-344da546be30 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:30.990722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 645/1292] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 26 12:29:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:33.226820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72034017-babb-4f08-8da2-c1f62bd2b8db None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:33.227384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72034017-babb-4f08-8da2-c1f62bd2b8db None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:33.227384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72034017-babb-4f08-8da2-c1f62bd2b8db None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:33.228751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 648/1293] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:33.236293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906d3fb-a294-4ffc-af8d-22ef91554ddc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:33.236777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906d3fb-a294-4ffc-af8d-22ef91554ddc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:33.236873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906d3fb-a294-4ffc-af8d-22ef91554ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:33.254192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a906d3fb-a294-4ffc-af8d-22ef91554ddc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:33.255046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a906d3fb-a294-4ffc-af8d-22ef91554ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:33.288140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:33.326735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 646/1294] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 12:29:33.350952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72034017-babb-4f08-8da2-c1f62bd2b8db None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:33.382994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:33.453601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72034017-babb-4f08-8da2-c1f62bd2b8db None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:33.486660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b559c6-684a-4b05-9306-66fe8a1c9945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:33.487248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b559c6-684a-4b05-9306-66fe8a1c9945 None admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:33.487523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b559c6-684a-4b05-9306-66fe8a1c9945 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:33.487791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b559c6-684a-4b05-9306-66fe8a1c9945 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:33.488558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b559c6-684a-4b05-9306-66fe8a1c9945 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:33.489840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b559c6-684a-4b05-9306-66fe8a1c9945 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:33.561979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 649/1295] 10.222.0.60 () {60 vars in 1141 bytes} [Thu May 26 12:29:33 2022] POST /identity/v3/services => generated 246 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:29:35.886062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3f38-c912-4dda-8fb9-688c6c06bb73 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:35.886626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3f38-c912-4dda-8fb9-688c6c06bb73 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:35.886626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3f38-c912-4dda-8fb9-688c6c06bb73 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:35.888096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 647/1296] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:35.895134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac657-4dbe-45b6-a9fc-792c95b714ab None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:35.895624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac657-4dbe-45b6-a9fc-792c95b714ab None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:35.895736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac657-4dbe-45b6-a9fc-792c95b714ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:35.912994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9a3ac657-4dbe-45b6-a9fc-792c95b714ab None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:35.914182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9a3ac657-4dbe-45b6-a9fc-792c95b714ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:35.988690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 650/1297] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:29:36.011776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb3f38-c912-4dda-8fb9-688c6c06bb73 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:36.120493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb3f38-c912-4dda-8fb9-688c6c06bb73 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:36.161819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:36.162582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:36.162863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:36.163134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:36.163807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:36.165394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:36.179321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:36.183759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:36.184672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 648/1298] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:29:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:36.188321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ac657-4dbe-45b6-a9fc-792c95b714ab None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:36.209537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:36.308776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ac657-4dbe-45b6-a9fc-792c95b714ab None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:36.349345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:36.350053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:36.350403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:36.350921 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:36.352069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:36.352375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:36.353797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:36.361180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 651/1299] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 26 12:29:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:36.367881 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:36.404886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:36.490795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdfbc5-1c81-4deb-b642-b2cf59a82f80 None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:36.526792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff553de4-c461-430d-9802-af2b7f38a59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:36.527459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff553de4-c461-430d-9802-af2b7f38a59c None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:36.527740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff553de4-c461-430d-9802-af2b7f38a59c None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:36.528170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff553de4-c461-430d-9802-af2b7f38a59c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:36.528970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff553de4-c461-430d-9802-af2b7f38a59c None admin] RBAC: Adding query filter params (interface=public, service_id=ddc324c112464894824cb1dd598cac08, region_id=RegionOne) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:36.529282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff553de4-c461-430d-9802-af2b7f38a59c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:36.531929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff553de4-c461-430d-9802-af2b7f38a59c None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:36.538489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 649/1300] 10.222.0.60 () {56 vars in 1251 bytes} [Thu May 26 12:29:36 2022] GET /identity/v3/endpoints?service_id=ddc324c112464894824cb1dd598cac08&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:29:36.544287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:36.646814 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:36.666966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd944b9c-128e-4b59-bc45-93f29143a830 None admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:36.704635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2296e43-7eb2-4266-8f98-24dbd94d0e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:36.705314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2296e43-7eb2-4266-8f98-24dbd94d0e4a None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:36.705700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2296e43-7eb2-4266-8f98-24dbd94d0e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:36.705974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2296e43-7eb2-4266-8f98-24dbd94d0e4a None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:36.706674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2296e43-7eb2-4266-8f98-24dbd94d0e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:36.708035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2296e43-7eb2-4266-8f98-24dbd94d0e4a None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:36.715239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 652/1301] 10.222.0.60 () {56 vars in 1087 bytes} [Thu May 26 12:29:36 2022] GET /identity/v3/services => generated 2191 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:29:38.972477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eed45b-a57a-4e31-80bd-a60e73925156 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:38.973040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eed45b-a57a-4e31-80bd-a60e73925156 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:38.973040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eed45b-a57a-4e31-80bd-a60e73925156 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:38.974404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 650/1302] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:29:38.979666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ee078-4ff3-4c18-9a28-1ef40a6d9a13 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:38.980088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ee078-4ff3-4c18-9a28-1ef40a6d9a13 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:38.980248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ee078-4ff3-4c18-9a28-1ef40a6d9a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:38.996823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ec8ee078-4ff3-4c18-9a28-1ef40a6d9a13 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:29:38.998007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ec8ee078-4ff3-4c18-9a28-1ef40a6d9a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:29:39.067262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 653/1303] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:29:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 12:29:39.090796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eed45b-a57a-4e31-80bd-a60e73925156 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:39.194382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:39.201077 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eed45b-a57a-4e31-80bd-a60e73925156 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:39.238570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:39.239295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:39.239576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:39.239852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:39.240500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:39.241852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 12:29:39.254268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 12:29:39.255584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.get_or_create( May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application with Lock( May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self._enter() May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application return self.creator() May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application created_value = creator( May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: ERROR keystone.server.flask.application May 26 12:29:39.256460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 651/1304] 10.222.0.60 () {56 vars in 1117 bytes} [Thu May 26 12:29:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 12:29:39.261776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ee078-4ff3-4c18-9a28-1ef40a6d9a13 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:39.342825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:39.377136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ee078-4ff3-4c18-9a28-1ef40a6d9a13 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:39.411166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea4a6a-0b05-4812-b04f-bd8efbdfc251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:39.411841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea4a6a-0b05-4812-b04f-bd8efbdfc251 None admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:39.412130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea4a6a-0b05-4812-b04f-bd8efbdfc251 None admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:39.412407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea4a6a-0b05-4812-b04f-bd8efbdfc251 None admin] PATH_INFO: `/v3/services` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:39.413119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea4a6a-0b05-4812-b04f-bd8efbdfc251 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:29:39.413422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea4a6a-0b05-4812-b04f-bd8efbdfc251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:39.414846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aea4a6a-0b05-4812-b04f-bd8efbdfc251 None admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:39.420144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 654/1305] 10.222.0.60 () {56 vars in 1116 bytes} [Thu May 26 12:29:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:29:39.426606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:29:39.535693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6df68ac-064f-4a8b-81f0-ebba7f03559b None admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:29:39.575923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090d94e-d6bc-409a-bdb3-c0ba5b8b48be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:29:39.576590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d94e-d6bc-409a-bdb3-c0ba5b8b48be None admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:29:39.576872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d94e-d6bc-409a-bdb3-c0ba5b8b48be None admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:29:39.577178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090d94e-d6bc-409a-bdb3-c0ba5b8b48be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:29:39.578265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090d94e-d6bc-409a-bdb3-c0ba5b8b48be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:29:39.579666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9090d94e-d6bc-409a-bdb3-c0ba5b8b48be None admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:29:39.683076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 652/1306] 10.222.0.60 () {60 vars in 1144 bytes} [Thu May 26 12:29:39 2022] POST /identity/v3/endpoints => generated 331 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:29:49.453855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=30 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:29:49.678039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:16.112498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7905c2-b9d9-448f-be70-8b76cf6798ac None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.113214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7905c2-b9d9-448f-be70-8b76cf6798ac None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.113214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7905c2-b9d9-448f-be70-8b76cf6798ac None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.115592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 655/1307] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:38:16.121383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894f86-8117-441b-af94-417bb6ef248e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.122126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894f86-8117-441b-af94-417bb6ef248e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.122126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c894f86-8117-441b-af94-417bb6ef248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.212155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7c894f86-8117-441b-af94-417bb6ef248e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:16.213401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7c894f86-8117-441b-af94-417bb6ef248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:16.351135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 653/1308] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:16.391418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedd86-394c-4d4c-a2d7-af952f8d7d6e None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.391791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedd86-394c-4d4c-a2d7-af952f8d7d6e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.391978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbedd86-394c-4d4c-a2d7-af952f8d7d6e None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.393904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 656/1309] 10.222.0.60 () {54 vars in 964 bytes} [Thu May 26 12:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:16.401614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97531d-2b38-4a74-802f-481824fd3bc6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.401960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97531d-2b38-4a74-802f-481824fd3bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.402185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97531d-2b38-4a74-802f-481824fd3bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.494429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cf97531d-2b38-4a74-802f-481824fd3bc6 None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:16.495703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cf97531d-2b38-4a74-802f-481824fd3bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:16.520058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:16.589575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 654/1310] 10.222.0.60 () {58 vars in 1061 bytes} [Thu May 26 12:38:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:16.601316 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedd86-394c-4d4c-a2d7-af952f8d7d6e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:16.603908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9cbedd86-394c-4d4c-a2d7-af952f8d7d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:16.744935 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbedd86-394c-4d4c-a2d7-af952f8d7d6e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:16.856245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e263761-b12a-433e-ac25-ba593b48857a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:16.856919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263761-b12a-433e-ac25-ba593b48857a service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:16.857196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263761-b12a-433e-ac25-ba593b48857a service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:16.857466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e263761-b12a-433e-ac25-ba593b48857a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:16.859518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0e263761-b12a-433e-ac25-ba593b48857a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:16.942129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:17.014961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e263761-b12a-433e-ac25-ba593b48857a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:17.016888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e263761-b12a-433e-ac25-ba593b48857a service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:17.044073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 657/1311] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:19.703407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95939-4507-4873-9a03-5c53f915c020 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.703959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95939-4507-4873-9a03-5c53f915c020 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.704054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d95939-4507-4873-9a03-5c53f915c020 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.705580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 655/1312] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:19.711501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17a94-7400-4ffc-88f2-744ce5585e85 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:19.711956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17a94-7400-4ffc-88f2-744ce5585e85 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:19.712054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17a94-7400-4ffc-88f2-744ce5585e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:19.795360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7fc17a94-7400-4ffc-88f2-744ce5585e85 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:19.796568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7fc17a94-7400-4ffc-88f2-744ce5585e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:19.899604 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 658/1313] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:19.960247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d95939-4507-4873-9a03-5c53f915c020 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:19.961785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-79d95939-4507-4873-9a03-5c53f915c020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:20.081115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d95939-4507-4873-9a03-5c53f915c020 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:20.162009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:20.164655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee0c75-a459-49fb-a535-d59c9ed5d0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:20.165503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0c75-a459-49fb-a535-d59c9ed5d0aa service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:20.165954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0c75-a459-49fb-a535-d59c9ed5d0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:20.166403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee0c75-a459-49fb-a535-d59c9ed5d0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:20.168262 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-51ee0c75-a459-49fb-a535-d59c9ed5d0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:20.307525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0c75-a459-49fb-a535-d59c9ed5d0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:20.309580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee0c75-a459-49fb-a535-d59c9ed5d0aa service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:20.332110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 656/1314] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:23.285094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3aed-f96f-4838-a0b4-0b4fa1944014 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.285616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3aed-f96f-4838-a0b4-0b4fa1944014 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.285713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a3aed-f96f-4838-a0b4-0b4fa1944014 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.290500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 659/1315] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:23.292877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ddd02-3a3b-4a1f-9e9a-e219654972a3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.293295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ddd02-3a3b-4a1f-9e9a-e219654972a3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.293434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4ddd02-3a3b-4a1f-9e9a-e219654972a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.361839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ab4ddd02-3a3b-4a1f-9e9a-e219654972a3 None None] MFA Rules not processed for user `839d126470c7460e8379a9881d54b5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:23.363114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ab4ddd02-3a3b-4a1f-9e9a-e219654972a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.420337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:23.469630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 657/1316] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:23.510347 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a3aed-f96f-4838-a0b4-0b4fa1944014 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:23.511919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0d1a3aed-f96f-4838-a0b4-0b4fa1944014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.524768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:23.621167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a3aed-f96f-4838-a0b4-0b4fa1944014 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:23.697223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b9882-126e-433e-bb5d-cd43094ae075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:23.697868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9882-126e-433e-bb5d-cd43094ae075 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:23.698145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9882-126e-433e-bb5d-cd43094ae075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:23.698413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b9882-126e-433e-bb5d-cd43094ae075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:23.700137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-da1b9882-126e-433e-bb5d-cd43094ae075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:23.765757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:23.811561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b9882-126e-433e-bb5d-cd43094ae075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:23.812971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b9882-126e-433e-bb5d-cd43094ae075 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:23.830919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 660/1317] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:27.108157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4796b1-08c4-46ef-9c43-66e4dccc2bdd None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.108735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4796b1-08c4-46ef-9c43-66e4dccc2bdd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.108735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4796b1-08c4-46ef-9c43-66e4dccc2bdd None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.110071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 658/1318] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:27.116135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f17f4-1133-48a0-9678-505300108110 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.116612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f17f4-1133-48a0-9678-505300108110 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.116750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f17f4-1133-48a0-9678-505300108110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.184417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ae9f17f4-1133-48a0-9678-505300108110 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:27.185648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ae9f17f4-1133-48a0-9678-505300108110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.286103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 661/1319] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:27.325790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4796b1-08c4-46ef-9c43-66e4dccc2bdd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:27.327498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6b4796b1-08c4-46ef-9c43-66e4dccc2bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.432783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4796b1-08c4-46ef-9c43-66e4dccc2bdd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:27.510076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1709faa-1112-49a4-8df7-0cfe6a8e18cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:27.510757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709faa-1112-49a4-8df7-0cfe6a8e18cd service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:27.511038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709faa-1112-49a4-8df7-0cfe6a8e18cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:27.511353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1709faa-1112-49a4-8df7-0cfe6a8e18cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:27.512994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a1709faa-1112-49a4-8df7-0cfe6a8e18cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:27.520801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:27.625358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1709faa-1112-49a4-8df7-0cfe6a8e18cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:27.626904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1709faa-1112-49a4-8df7-0cfe6a8e18cd service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:27.645602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 659/1320] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:31.022820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a98c20-24a7-4002-abf5-9562cd72bfe3 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:31.023259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a98c20-24a7-4002-abf5-9562cd72bfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:31.023643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a98c20-24a7-4002-abf5-9562cd72bfe3 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:31.025765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 662/1321] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:31.032062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398086-5392-4e2c-988f-00d201785ca2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:31.032506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398086-5392-4e2c-988f-00d201785ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:31.032600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3398086-5392-4e2c-988f-00d201785ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:31.103101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d3398086-5392-4e2c-988f-00d201785ca2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:31.104324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d3398086-5392-4e2c-988f-00d201785ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:31.166681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:31.206187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 660/1322] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:31.242979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a98c20-24a7-4002-abf5-9562cd72bfe3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:31.244510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b0a98c20-24a7-4002-abf5-9562cd72bfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:31.264543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:31.352823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a98c20-24a7-4002-abf5-9562cd72bfe3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:31.435646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe27fe-91b1-40c8-8a9f-a9967e821259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:31.436307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe27fe-91b1-40c8-8a9f-a9967e821259 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:31.436654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe27fe-91b1-40c8-8a9f-a9967e821259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:31.436944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe27fe-91b1-40c8-8a9f-a9967e821259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:31.438619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-defe27fe-91b1-40c8-8a9f-a9967e821259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:31.525244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:31.567389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe27fe-91b1-40c8-8a9f-a9967e821259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:31.569346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defe27fe-91b1-40c8-8a9f-a9967e821259 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:31.591794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 663/1323] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:33.978311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f35cda-ecf1-461c-bea8-6d6db061e14f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:33.978918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f35cda-ecf1-461c-bea8-6d6db061e14f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:33.978918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f35cda-ecf1-461c-bea8-6d6db061e14f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:33.980314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 661/1324] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:33.985924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61c17-20d2-44a4-8a92-f320cf3a6b4a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:33.986394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61c17-20d2-44a4-8a92-f320cf3a6b4a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:33.986560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c61c17-20d2-44a4-8a92-f320cf3a6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:34.056147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-02c61c17-20d2-44a4-8a92-f320cf3a6b4a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:34.057363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-02c61c17-20d2-44a4-8a92-f320cf3a6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:34.167832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 664/1325] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:34.204943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f35cda-ecf1-461c-bea8-6d6db061e14f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:34.206506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-69f35cda-ecf1-461c-bea8-6d6db061e14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:34.338057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f35cda-ecf1-461c-bea8-6d6db061e14f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:34.414627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c151a-2f8c-4e3e-bbb3-45ae61b4b11a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:34.415297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c151a-2f8c-4e3e-bbb3-45ae61b4b11a service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:34.415576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c151a-2f8c-4e3e-bbb3-45ae61b4b11a service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:34.415848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c151a-2f8c-4e3e-bbb3-45ae61b4b11a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:34.417496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b94c151a-2f8c-4e3e-bbb3-45ae61b4b11a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:34.435633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:34.531673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c151a-2f8c-4e3e-bbb3-45ae61b4b11a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:34.533322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c151a-2f8c-4e3e-bbb3-45ae61b4b11a service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:34.551708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 662/1326] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:36.888297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafee95-2ad5-41eb-970d-a4e0dd9c605d None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.888839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafee95-2ad5-41eb-970d-a4e0dd9c605d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.888839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafee95-2ad5-41eb-970d-a4e0dd9c605d None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.890239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 665/1327] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:38:36.896253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aeb3c-1c75-47ee-ba83-7c1d4bb9b9ed None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:36.896733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aeb3c-1c75-47ee-ba83-7c1d4bb9b9ed None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:36.896824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630aeb3c-1c75-47ee-ba83-7c1d4bb9b9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:36.963614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-630aeb3c-1c75-47ee-ba83-7c1d4bb9b9ed None None] MFA Rules not processed for user `839d126470c7460e8379a9881d54b5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:36.964835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-630aeb3c-1c75-47ee-ba83-7c1d4bb9b9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:37.038408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:37.073598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 663/1328] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:37.111467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafee95-2ad5-41eb-970d-a4e0dd9c605d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:37.113092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-aaafee95-2ad5-41eb-970d-a4e0dd9c605d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:37.145752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:37.229060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafee95-2ad5-41eb-970d-a4e0dd9c605d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:37.309068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b6d97c-c534-4bd3-b97d-fff83a6d9fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:37.309720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d97c-c534-4bd3-b97d-fff83a6d9fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:37.309997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d97c-c534-4bd3-b97d-fff83a6d9fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:37.310267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b6d97c-c534-4bd3-b97d-fff83a6d9fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:37.311946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e9b6d97c-c534-4bd3-b97d-fff83a6d9fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:37.395198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:37.429049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6d97c-c534-4bd3-b97d-fff83a6d9fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:37.430361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b6d97c-c534-4bd3-b97d-fff83a6d9fdc service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:37.450393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 666/1329] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:40.348597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75f300-9d90-4f41-812d-52d5cfde57a7 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.349215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75f300-9d90-4f41-812d-52d5cfde57a7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.349215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75f300-9d90-4f41-812d-52d5cfde57a7 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.350723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 664/1330] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:40.356230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26423-2929-4ec8-97dc-f8230054bbcc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.356694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26423-2929-4ec8-97dc-f8230054bbcc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.356796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26423-2929-4ec8-97dc-f8230054bbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.436659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ede26423-2929-4ec8-97dc-f8230054bbcc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:40.437881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ede26423-2929-4ec8-97dc-f8230054bbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:40.540291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 667/1331] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:40.577184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75f300-9d90-4f41-812d-52d5cfde57a7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:40.578748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3a75f300-9d90-4f41-812d-52d5cfde57a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:40.690469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75f300-9d90-4f41-812d-52d5cfde57a7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:40.780736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbf838-fc35-401a-ab12-aac3a9177a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:40.781439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf838-fc35-401a-ab12-aac3a9177a55 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:40.781742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf838-fc35-401a-ab12-aac3a9177a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:40.782065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbf838-fc35-401a-ab12-aac3a9177a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:40.783868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-12fbf838-fc35-401a-ab12-aac3a9177a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:40.815914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:40.919737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbf838-fc35-401a-ab12-aac3a9177a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:40.921174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbf838-fc35-401a-ab12-aac3a9177a55 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:40.942005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 665/1332] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:43.263379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214cafd-001a-450c-8aca-64613412249c None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.269145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214cafd-001a-450c-8aca-64613412249c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.269145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214cafd-001a-450c-8aca-64613412249c None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.269145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 668/1333] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:43.270779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381df5-ef58-4108-94d0-dc9cb7c1ca3b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.272632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381df5-ef58-4108-94d0-dc9cb7c1ca3b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.272913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381df5-ef58-4108-94d0-dc9cb7c1ca3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.339227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-46381df5-ef58-4108-94d0-dc9cb7c1ca3b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:43.340423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-46381df5-ef58-4108-94d0-dc9cb7c1ca3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.417618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:43.442493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 666/1334] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:43.497324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80a41-3eeb-44e7-9e13-18e82eb83660 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.497609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80a41-3eeb-44e7-9e13-18e82eb83660 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.497886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e80a41-3eeb-44e7-9e13-18e82eb83660 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.499313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 669/1335] 10.222.0.60 () {54 vars in 964 bytes} [Thu May 26 12:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:43.505144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d2d5-3d8e-48b5-bc6b-5df048a171ce None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.505540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d2d5-3d8e-48b5-bc6b-5df048a171ce None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.505818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000d2d5-3d8e-48b5-bc6b-5df048a171ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.580975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7000d2d5-3d8e-48b5-bc6b-5df048a171ce None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:43.582082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7000d2d5-3d8e-48b5-bc6b-5df048a171ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.656074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 667/1336] 10.222.0.60 () {58 vars in 1061 bytes} [Thu May 26 12:38:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:38:43.665623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80a41-3eeb-44e7-9e13-18e82eb83660 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:43.667205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e5e80a41-3eeb-44e7-9e13-18e82eb83660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.707209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:43.771220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e80a41-3eeb-44e7-9e13-18e82eb83660 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:43.843631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd71771-72ad-4113-a4a4-e7552a71972c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:43.843948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd71771-72ad-4113-a4a4-e7552a71972c service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:43.844232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd71771-72ad-4113-a4a4-e7552a71972c service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:43.844503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd71771-72ad-4113-a4a4-e7552a71972c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:43.846123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bbd71771-72ad-4113-a4a4-e7552a71972c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:43.929179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:43.954824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd71771-72ad-4113-a4a4-e7552a71972c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:43.956275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd71771-72ad-4113-a4a4-e7552a71972c service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:43.974193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 670/1337] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:47.570268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f74a-e880-4e40-80be-1bb951ec7122 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:47.570819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f74a-e880-4e40-80be-1bb951ec7122 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:47.570819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748f74a-e880-4e40-80be-1bb951ec7122 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:47.572182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 668/1338] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:47.577420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635917a-ddf4-4440-b369-e2a9b008903a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:47.577811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635917a-ddf4-4440-b369-e2a9b008903a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:47.577985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7635917a-ddf4-4440-b369-e2a9b008903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:47.648802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7635917a-ddf4-4440-b369-e2a9b008903a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:47.650015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7635917a-ddf4-4440-b369-e2a9b008903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:47.759357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 671/1339] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:47.795854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748f74a-e880-4e40-80be-1bb951ec7122 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:47.798086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7748f74a-e880-4e40-80be-1bb951ec7122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:47.881494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:38:47.896810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748f74a-e880-4e40-80be-1bb951ec7122 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:47.900417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d947e68-9a07-42fe-a84a-2c76b06b294f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:47.901061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947e68-9a07-42fe-a84a-2c76b06b294f service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:47.901338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947e68-9a07-42fe-a84a-2c76b06b294f service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:47.901608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d947e68-9a07-42fe-a84a-2c76b06b294f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:47.910363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d947e68-9a07-42fe-a84a-2c76b06b294f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:47.911898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d947e68-9a07-42fe-a84a-2c76b06b294f service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:47.920992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 669/1340] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:52.955412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23fe8-ac35-4c06-b35a-e9047edfec32 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.955412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23fe8-ac35-4c06-b35a-e9047edfec32 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.955412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb23fe8-ac35-4c06-b35a-e9047edfec32 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.955412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 672/1341] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:52.956091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd68890-569c-4204-a8e6-79ffc3ebe214 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:52.956091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd68890-569c-4204-a8e6-79ffc3ebe214 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:52.956091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd68890-569c-4204-a8e6-79ffc3ebe214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:52.985746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-afd68890-569c-4204-a8e6-79ffc3ebe214 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:52.987018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-afd68890-569c-4204-a8e6-79ffc3ebe214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:53.073960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 670/1342] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:53.116387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb23fe8-ac35-4c06-b35a-e9047edfec32 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:53.127243 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb23fe8-ac35-4c06-b35a-e9047edfec32 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:53.131332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384ec7a-005c-4a7d-bddb-e7c262a546c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:53.131985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384ec7a-005c-4a7d-bddb-e7c262a546c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:53.132261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384ec7a-005c-4a7d-bddb-e7c262a546c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:53.132525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384ec7a-005c-4a7d-bddb-e7c262a546c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:53.146861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384ec7a-005c-4a7d-bddb-e7c262a546c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:53.148158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384ec7a-005c-4a7d-bddb-e7c262a546c3 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:53.158012 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 673/1343] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:38:56.750260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d46e-cb43-419a-89fc-2faa8014a983 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:56.750842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d46e-cb43-419a-89fc-2faa8014a983 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:56.750842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5d46e-cb43-419a-89fc-2faa8014a983 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:56.752233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 671/1344] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:38:56.758259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346737c0-9a1c-45d1-8a40-08070ed2a74c None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:56.758847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346737c0-9a1c-45d1-8a40-08070ed2a74c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:56.758847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346737c0-9a1c-45d1-8a40-08070ed2a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:56.777571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-346737c0-9a1c-45d1-8a40-08070ed2a74c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:38:56.778792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-346737c0-9a1c-45d1-8a40-08070ed2a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:38:56.786784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 674/1345] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:38:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:38:56.825256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5d46e-cb43-419a-89fc-2faa8014a983 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:38:56.837460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5d46e-cb43-419a-89fc-2faa8014a983 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:38:56.841315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f47fe-408e-4dce-8469-d492d7bbeda0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:38:56.842074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f47fe-408e-4dce-8469-d492d7bbeda0 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:38:56.842361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f47fe-408e-4dce-8469-d492d7bbeda0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:38:56.842667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f47fe-408e-4dce-8469-d492d7bbeda0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:38:56.854897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f47fe-408e-4dce-8469-d492d7bbeda0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:38:56.856615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26f47fe-408e-4dce-8469-d492d7bbeda0 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:38:56.868420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 672/1346] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:38:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:01.546190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348098-ecc4-4f71-8fb4-feb751e981fa None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.546800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348098-ecc4-4f71-8fb4-feb751e981fa None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.546800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5348098-ecc4-4f71-8fb4-feb751e981fa None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.548163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 675/1347] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:01.553702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be364668-da09-4443-983d-485c32132def None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.554169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be364668-da09-4443-983d-485c32132def None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.554265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be364668-da09-4443-983d-485c32132def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.574507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-be364668-da09-4443-983d-485c32132def None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:01.581339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-be364668-da09-4443-983d-485c32132def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.584604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 673/1348] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:01.624745 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348098-ecc4-4f71-8fb4-feb751e981fa None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:01.626507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e5348098-ecc4-4f71-8fb4-feb751e981fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:01.640379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5348098-ecc4-4f71-8fb4-feb751e981fa None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:01.644665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652d245-f4ac-40a5-b1e1-560c99c9f323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:01.645397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d245-f4ac-40a5-b1e1-560c99c9f323 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:01.645678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d245-f4ac-40a5-b1e1-560c99c9f323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:01.647018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652d245-f4ac-40a5-b1e1-560c99c9f323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:01.659583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d245-f4ac-40a5-b1e1-560c99c9f323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:01.661027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652d245-f4ac-40a5-b1e1-560c99c9f323 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:01.672843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 676/1349] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:07.334947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5a614-9dbf-4dda-93be-406b0801cc4c None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.342927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5a614-9dbf-4dda-93be-406b0801cc4c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.342927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5a614-9dbf-4dda-93be-406b0801cc4c None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.342927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 674/1350] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:07.343187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca315c-800b-4353-b07a-31b9ae9980ed None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:07.343792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca315c-800b-4353-b07a-31b9ae9980ed None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:07.344315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca315c-800b-4353-b07a-31b9ae9980ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:07.368463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:07.452094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b1ca315c-800b-4353-b07a-31b9ae9980ed None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:07.453845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b1ca315c-800b-4353-b07a-31b9ae9980ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:07.628730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 677/1351] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:39:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:11.569155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=57 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:12.197798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545a32-84e2-40cc-9ff3-c3eabb6a1eb0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:12.198304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545a32-84e2-40cc-9ff3-c3eabb6a1eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:12.198723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6545a32-84e2-40cc-9ff3-c3eabb6a1eb0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:12.200246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 675/1352] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:12.205897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7afe-f2b9-4821-972a-52082e59c62a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:12.206440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7afe-f2b9-4821-972a-52082e59c62a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:12.206440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f7afe-f2b9-4821-972a-52082e59c62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:12.226278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-3c8f7afe-f2b9-4821-972a-52082e59c62a None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:12.227544 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3c8f7afe-f2b9-4821-972a-52082e59c62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:12.236341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 678/1353] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:39:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:13.541209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ed103-8d01-4cba-af0f-b3180a14d927 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:13.541733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ed103-8d01-4cba-af0f-b3180a14d927 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:13.541733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ed103-8d01-4cba-af0f-b3180a14d927 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:13.543106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 676/1354] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:13.548824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a7df-7631-473e-95a3-cf15280cd75d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:13.549351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a7df-7631-473e-95a3-cf15280cd75d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:13.549351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414a7df-7631-473e-95a3-cf15280cd75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:13.570442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-3414a7df-7631-473e-95a3-cf15280cd75d None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:13.571687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3414a7df-7631-473e-95a3-cf15280cd75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:13.580317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 679/1355] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:39:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:17.745747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa78a-3bcb-4716-82ef-2fa02083582b None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:17.746333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa78a-3bcb-4716-82ef-2fa02083582b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:17.746333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fa78a-3bcb-4716-82ef-2fa02083582b None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:17.747738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 677/1356] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:17.753247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab324fb-a79e-415d-94db-f30279eb72a7 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:17.754007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab324fb-a79e-415d-94db-f30279eb72a7 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:17.754007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab324fb-a79e-415d-94db-f30279eb72a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:17.778767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-0ab324fb-a79e-415d-94db-f30279eb72a7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:17.780162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0ab324fb-a79e-415d-94db-f30279eb72a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:17.789317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 680/1357] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:17.851156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abf504-0785-4351-a242-67110be2aa1f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:17.851534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abf504-0785-4351-a242-67110be2aa1f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:17.852047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abf504-0785-4351-a242-67110be2aa1f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:17.853812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 678/1358] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 26 12:39:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:17.862116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be906b9f-5ca5-43de-903e-b71452abb324 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:17.862514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be906b9f-5ca5-43de-903e-b71452abb324 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:17.863065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be906b9f-5ca5-43de-903e-b71452abb324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:17.934620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-be906b9f-5ca5-43de-903e-b71452abb324 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:17.934620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-be906b9f-5ca5-43de-903e-b71452abb324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:18.000693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:18.038729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 681/1359] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 26 12:39:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:18.047946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abf504-0785-4351-a242-67110be2aa1f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:18.069765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abf504-0785-4351-a242-67110be2aa1f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:18.077874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c3eec-8173-4b20-ae84-3c1846571de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:18.078545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c3eec-8173-4b20-ae84-3c1846571de3 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:18.078851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c3eec-8173-4b20-ae84-3c1846571de3 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:18.079132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c3eec-8173-4b20-ae84-3c1846571de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:18.089109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c3eec-8173-4b20-ae84-3c1846571de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:18.090723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c3eec-8173-4b20-ae84-3c1846571de3 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:18.102352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 679/1360] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:20.914797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca46989-48be-40d5-a71e-50227f4b7920 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:20.915371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca46989-48be-40d5-a71e-50227f4b7920 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:20.915606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca46989-48be-40d5-a71e-50227f4b7920 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:20.917159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 682/1361] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:20.929052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e743a-b93c-4c4a-bd7e-c7de43e4c752 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:20.929052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e743a-b93c-4c4a-bd7e-c7de43e4c752 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:20.929698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e743a-b93c-4c4a-bd7e-c7de43e4c752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:20.947498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7f7e743a-b93c-4c4a-bd7e-c7de43e4c752 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:20.948696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7f7e743a-b93c-4c4a-bd7e-c7de43e4c752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:20.957148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 680/1362] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:21.003153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca46989-48be-40d5-a71e-50227f4b7920 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:21.019561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca46989-48be-40d5-a71e-50227f4b7920 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:21.027561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a26c2-992f-4757-ab65-2eddfa81e315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:21.028439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a26c2-992f-4757-ab65-2eddfa81e315 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:21.028889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a26c2-992f-4757-ab65-2eddfa81e315 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:21.029306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a26c2-992f-4757-ab65-2eddfa81e315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:21.039566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a26c2-992f-4757-ab65-2eddfa81e315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:21.041380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a26c2-992f-4757-ab65-2eddfa81e315 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:21.053966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 683/1363] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:23.773077 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752126-d3c8-4e6b-84c9-61c21f3bd8dc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.773614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752126-d3c8-4e6b-84c9-61c21f3bd8dc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.773614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41752126-d3c8-4e6b-84c9-61c21f3bd8dc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.775053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 681/1364] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:23.780672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a247d4-554f-41dc-afd1-4bdff78e3704 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.781121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a247d4-554f-41dc-afd1-4bdff78e3704 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.781238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a247d4-554f-41dc-afd1-4bdff78e3704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.800172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b4a247d4-554f-41dc-afd1-4bdff78e3704 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:23.801271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b4a247d4-554f-41dc-afd1-4bdff78e3704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.810073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 684/1365] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:23.858552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871a3a8-97ef-48de-a48e-9f9441fc6248 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.858853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871a3a8-97ef-48de-a48e-9f9441fc6248 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.859123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871a3a8-97ef-48de-a48e-9f9441fc6248 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.860687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 682/1366] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 26 12:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:23.867294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90694052-fd98-45b1-b7c0-b54884de6500 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.867587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90694052-fd98-45b1-b7c0-b54884de6500 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.867865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90694052-fd98-45b1-b7c0-b54884de6500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.887638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-90694052-fd98-45b1-b7c0-b54884de6500 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:23.888863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-90694052-fd98-45b1-b7c0-b54884de6500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:23.898738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 685/1367] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 26 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:23.906965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871a3a8-97ef-48de-a48e-9f9441fc6248 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:23.922013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871a3a8-97ef-48de-a48e-9f9441fc6248 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:23.928280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6de41-38e3-4070-972f-632fe80abbee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:23.928925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6de41-38e3-4070-972f-632fe80abbee service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:23.929221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6de41-38e3-4070-972f-632fe80abbee service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:23.929502 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6de41-38e3-4070-972f-632fe80abbee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:23.938476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6de41-38e3-4070-972f-632fe80abbee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:23.940143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6de41-38e3-4070-972f-632fe80abbee service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:23.951159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 683/1368] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:26.460798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368440c-fd2b-4ec9-8449-b2f879538410 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.461709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368440c-fd2b-4ec9-8449-b2f879538410 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.462001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368440c-fd2b-4ec9-8449-b2f879538410 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.463496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 686/1369] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:26.469408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b13c92-77b2-4695-a829-94340ca15bb0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.469852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b13c92-77b2-4695-a829-94340ca15bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.469957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b13c92-77b2-4695-a829-94340ca15bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.489283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-02b13c92-77b2-4695-a829-94340ca15bb0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:26.490624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-02b13c92-77b2-4695-a829-94340ca15bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.498961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 684/1370] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:26.545392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368440c-fd2b-4ec9-8449-b2f879538410 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:26.554033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc315-a4a9-4ffa-9c04-e06dff482a57 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.561846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc315-a4a9-4ffa-9c04-e06dff482a57 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.561846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc315-a4a9-4ffa-9c04-e06dff482a57 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.561846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 685/1371] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:39:26.562479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecca6e-1c5b-4acf-b48f-fb0b24272f6b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.562822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecca6e-1c5b-4acf-b48f-fb0b24272f6b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.563304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecca6e-1c5b-4acf-b48f-fb0b24272f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.563922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368440c-fd2b-4ec9-8449-b2f879538410 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:26.572347 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8219ddd-a0d2-4dda-b3e2-ab9c9f25d287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:26.573553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219ddd-a0d2-4dda-b3e2-ab9c9f25d287 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.573941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219ddd-a0d2-4dda-b3e2-ab9c9f25d287 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.574304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8219ddd-a0d2-4dda-b3e2-ab9c9f25d287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.583279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4fecca6e-1c5b-4acf-b48f-fb0b24272f6b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:26.585168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4fecca6e-1c5b-4acf-b48f-fb0b24272f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:26.585400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219ddd-a0d2-4dda-b3e2-ab9c9f25d287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:26.587198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8219ddd-a0d2-4dda-b3e2-ab9c9f25d287 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:26.593937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 686/1372] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:26.601642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 687/1373] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:26.910673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bcbf6-b40a-48ff-80a5-7a57a42e043a None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.911060 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bcbf6-b40a-48ff-80a5-7a57a42e043a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.911440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77bcbf6-b40a-48ff-80a5-7a57a42e043a None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.913416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 687/1374] 10.222.0.60 () {54 vars in 963 bytes} [Thu May 26 12:39:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:26.920392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fafd-6efa-4a99-ace2-b244d57d0b24 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:26.920831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fafd-6efa-4a99-ace2-b244d57d0b24 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:26.921225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fafd-6efa-4a99-ace2-b244d57d0b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:26.981980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ad24fafd-6efa-4a99-ace2-b244d57d0b24 None None] MFA Rules not processed for user `17335764c3fd4960ab969211ca353b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:26.983431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ad24fafd-6efa-4a99-ace2-b244d57d0b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:27.056959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 688/1375] 10.222.0.60 () {58 vars in 1060 bytes} [Thu May 26 12:39:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:27.064696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bcbf6-b40a-48ff-80a5-7a57a42e043a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:27.078085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77bcbf6-b40a-48ff-80a5-7a57a42e043a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:27.081868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b0a68-1357-4c2a-a73d-6fa07e407d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:27.082612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0a68-1357-4c2a-a73d-6fa07e407d9a service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:27.082867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0a68-1357-4c2a-a73d-6fa07e407d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:27.083375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b0a68-1357-4c2a-a73d-6fa07e407d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:27.094281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0a68-1357-4c2a-a73d-6fa07e407d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:27.096311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b0a68-1357-4c2a-a73d-6fa07e407d9a service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:27.107553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 688/1376] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:29.145276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da066e-f56e-4d66-9dce-0aa3d654caa7 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.145879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da066e-f56e-4d66-9dce-0aa3d654caa7 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.146603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da066e-f56e-4d66-9dce-0aa3d654caa7 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.150824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 689/1377] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:29.156579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c7b-0ba8-414e-803e-2eb508467106 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.157088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c7b-0ba8-414e-803e-2eb508467106 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.163167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd18c7b-0ba8-414e-803e-2eb508467106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.176127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0bd18c7b-0ba8-414e-803e-2eb508467106 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:29.177364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0bd18c7b-0ba8-414e-803e-2eb508467106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:29.185475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 689/1378] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:29.232093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da066e-f56e-4d66-9dce-0aa3d654caa7 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:29.247905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da066e-f56e-4d66-9dce-0aa3d654caa7 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:29.253447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319b790-05e7-44bb-9a72-794dc55813ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:29.254236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319b790-05e7-44bb-9a72-794dc55813ac service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:29.254516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319b790-05e7-44bb-9a72-794dc55813ac service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:29.256567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319b790-05e7-44bb-9a72-794dc55813ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:29.264664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319b790-05e7-44bb-9a72-794dc55813ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:29.266272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319b790-05e7-44bb-9a72-794dc55813ac service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:29.277601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 690/1379] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:31.787738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9e58-7791-48ab-a2ef-792de3f03ccf None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.788777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9e58-7791-48ab-a2ef-792de3f03ccf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.789317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd9e58-7791-48ab-a2ef-792de3f03ccf None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.791122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 690/1380] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:31.796504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764df2-9ba6-45fc-864f-59597d21ca95 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.797240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764df2-9ba6-45fc-864f-59597d21ca95 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.797674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764df2-9ba6-45fc-864f-59597d21ca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.817724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-af764df2-9ba6-45fc-864f-59597d21ca95 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:31.819274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-af764df2-9ba6-45fc-864f-59597d21ca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:31.828017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 691/1381] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:31.874669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd9e58-7791-48ab-a2ef-792de3f03ccf None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:31.889784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd9e58-7791-48ab-a2ef-792de3f03ccf None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:31.895537 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e28b1-05ef-48e2-995b-a98623888f00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:31.896759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e28b1-05ef-48e2-995b-a98623888f00 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:31.897028 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e28b1-05ef-48e2-995b-a98623888f00 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:31.897489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e28b1-05ef-48e2-995b-a98623888f00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:31.907694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e28b1-05ef-48e2-995b-a98623888f00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:31.909195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e28b1-05ef-48e2-995b-a98623888f00 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:31.921599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 691/1382] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:34.445276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1d579-ba44-4e93-886c-adecbcc289b6 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:34.445831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1d579-ba44-4e93-886c-adecbcc289b6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:34.445831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1d579-ba44-4e93-886c-adecbcc289b6 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:34.447259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 692/1383] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:34.453445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49568-2a88-40b1-85c2-9426406d1eb2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:34.453971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49568-2a88-40b1-85c2-9426406d1eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:34.454260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49568-2a88-40b1-85c2-9426406d1eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:34.481008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6cd49568-2a88-40b1-85c2-9426406d1eb2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:34.482460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6cd49568-2a88-40b1-85c2-9426406d1eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:34.501811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 692/1384] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:34.544106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1d579-ba44-4e93-886c-adecbcc289b6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:34.559925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1d579-ba44-4e93-886c-adecbcc289b6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:34.565622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51599c4d-1fec-4f3f-9271-f4f8304ac81c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:34.566376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51599c4d-1fec-4f3f-9271-f4f8304ac81c service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:34.566780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51599c4d-1fec-4f3f-9271-f4f8304ac81c service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:34.567148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51599c4d-1fec-4f3f-9271-f4f8304ac81c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:34.576366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51599c4d-1fec-4f3f-9271-f4f8304ac81c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:34.578122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51599c4d-1fec-4f3f-9271-f4f8304ac81c service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:34.594279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 693/1385] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:36.946549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220aa2f-aa99-471a-9a67-40b261dcbf4d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:36.947107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220aa2f-aa99-471a-9a67-40b261dcbf4d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:36.947107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220aa2f-aa99-471a-9a67-40b261dcbf4d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:36.948590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 693/1386] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:36.954336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766098-23fb-441f-91d5-8010e19dc23a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:36.954857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766098-23fb-441f-91d5-8010e19dc23a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:36.954947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87766098-23fb-441f-91d5-8010e19dc23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:36.973476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-87766098-23fb-441f-91d5-8010e19dc23a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:36.974762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-87766098-23fb-441f-91d5-8010e19dc23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:36.982950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 694/1387] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:37.030555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220aa2f-aa99-471a-9a67-40b261dcbf4d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:37.046120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220aa2f-aa99-471a-9a67-40b261dcbf4d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:37.051964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941860af-0c35-4565-a901-21d60e9d56ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:37.052679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941860af-0c35-4565-a901-21d60e9d56ea service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:37.054287 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941860af-0c35-4565-a901-21d60e9d56ea service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:37.054287 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941860af-0c35-4565-a901-21d60e9d56ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:37.066813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941860af-0c35-4565-a901-21d60e9d56ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:37.069392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941860af-0c35-4565-a901-21d60e9d56ea service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:37.080368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 694/1388] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:39.573782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2cd7-d001-410f-8311-ac48e2a92c13 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.574319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2cd7-d001-410f-8311-ac48e2a92c13 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.574319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef2cd7-d001-410f-8311-ac48e2a92c13 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.575968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 695/1389] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:39.581513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2dca-a048-49ce-ad60-fb84f7310021 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.582452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2dca-a048-49ce-ad60-fb84f7310021 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.582817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d2dca-a048-49ce-ad60-fb84f7310021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.602807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d55d2dca-a048-49ce-ad60-fb84f7310021 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:39.604059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d55d2dca-a048-49ce-ad60-fb84f7310021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:39.612893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 695/1390] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:39.664173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2cd7-d001-410f-8311-ac48e2a92c13 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:39.688123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef2cd7-d001-410f-8311-ac48e2a92c13 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:39.703318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d47372-3654-49d1-964b-79df87a27d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:39.704246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d47372-3654-49d1-964b-79df87a27d56 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:39.704610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d47372-3654-49d1-964b-79df87a27d56 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:39.705661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d47372-3654-49d1-964b-79df87a27d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:39.718705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d47372-3654-49d1-964b-79df87a27d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:39.720291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d47372-3654-49d1-964b-79df87a27d56 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:39.734640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 696/1391] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:42.544227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45922e5c-49ef-4c69-9eef-0bcee4077351 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:42.544803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45922e5c-49ef-4c69-9eef-0bcee4077351 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:42.544803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45922e5c-49ef-4c69-9eef-0bcee4077351 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:42.546066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 696/1392] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:39:42.551584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bc25a-f4f3-4780-93a3-ec128f017890 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:42.551997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bc25a-f4f3-4780-93a3-ec128f017890 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:42.552144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bc25a-f4f3-4780-93a3-ec128f017890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:42.571306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f39bc25a-f4f3-4780-93a3-ec128f017890 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:42.572533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f39bc25a-f4f3-4780-93a3-ec128f017890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:42.580594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 697/1393] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:42.626848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45922e5c-49ef-4c69-9eef-0bcee4077351 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:42.636467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=49 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:42.643793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45922e5c-49ef-4c69-9eef-0bcee4077351 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:42.650987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b231f1a-7f04-4711-ba8e-bb34850768f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:42.651127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b231f1a-7f04-4711-ba8e-bb34850768f7 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:42.651285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b231f1a-7f04-4711-ba8e-bb34850768f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:42.651587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b231f1a-7f04-4711-ba8e-bb34850768f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:42.661437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b231f1a-7f04-4711-ba8e-bb34850768f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:42.663712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b231f1a-7f04-4711-ba8e-bb34850768f7 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:42.673864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 697/1394] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:43.872250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3abc-9f01-4541-8fb1-fa508f92ad7e None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:43.873934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3abc-9f01-4541-8fb1-fa508f92ad7e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:43.873934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d3abc-9f01-4541-8fb1-fa508f92ad7e None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:43.875245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 698/1395] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:43.881922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213eff-75bb-4a64-8d1d-00b5644aa48c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:43.882446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213eff-75bb-4a64-8d1d-00b5644aa48c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:43.882650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e213eff-75bb-4a64-8d1d-00b5644aa48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:43.901123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8e213eff-75bb-4a64-8d1d-00b5644aa48c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:43.902327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8e213eff-75bb-4a64-8d1d-00b5644aa48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:43.911719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 698/1396] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:43.977687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e131a-1fdf-4ff0-b022-3d732de22bf8 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:43.978041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e131a-1fdf-4ff0-b022-3d732de22bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:43.978325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e131a-1fdf-4ff0-b022-3d732de22bf8 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:43.979790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 699/1397] 10.222.0.60 () {54 vars in 962 bytes} [Thu May 26 12:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:39:43.985760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb350f-b706-4ee3-ad05-d3038c223c93 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:43.986228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb350f-b706-4ee3-ad05-d3038c223c93 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:43.986678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb350f-b706-4ee3-ad05-d3038c223c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:44.046091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9dfb350f-b706-4ee3-ad05-d3038c223c93 None None] MFA Rules not processed for user `175b409f5ee842ddb9f5f3468a6a461b`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:44.047353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9dfb350f-b706-4ee3-ad05-d3038c223c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:44.129353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 699/1398] 10.222.0.60 () {58 vars in 1059 bytes} [Thu May 26 12:39:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:44.136842 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e131a-1fdf-4ff0-b022-3d732de22bf8 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:44.148191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e131a-1fdf-4ff0-b022-3d732de22bf8 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:44.151686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9b535-be84-4947-abbf-50ade1a1d811 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:44.152331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b535-be84-4947-abbf-50ade1a1d811 service glance] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:44.152611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b535-be84-4947-abbf-50ade1a1d811 service glance] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:44.152876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9b535-be84-4947-abbf-50ade1a1d811 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:44.162737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9b535-be84-4947-abbf-50ade1a1d811 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:44.164092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9b535-be84-4947-abbf-50ade1a1d811 service glance] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:44.174312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 700/1399] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:44.924549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eed48-3af0-4db9-94ba-75857b19194e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:44.925081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eed48-3af0-4db9-94ba-75857b19194e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:44.925183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6eed48-3af0-4db9-94ba-75857b19194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:44.979459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bd6eed48-3af0-4db9-94ba-75857b19194e None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:44.980675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bd6eed48-3af0-4db9-94ba-75857b19194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:45.061992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 700/1400] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:39:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:45.110653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29fd7-9393-4eca-84af-a0bfb3ee86ba None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:45.111205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29fd7-9393-4eca-84af-a0bfb3ee86ba None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:45.111205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe29fd7-9393-4eca-84af-a0bfb3ee86ba None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:45.112614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 701/1401] 10.222.0.60 () {54 vars in 942 bytes} [Thu May 26 12:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:45.119941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8635000-1566-4dc8-974b-e431b3cf8700 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:45.120374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8635000-1566-4dc8-974b-e431b3cf8700 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:45.120658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8635000-1566-4dc8-974b-e431b3cf8700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:45.171285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:45.174357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f8635000-1566-4dc8-974b-e431b3cf8700 None None] MFA Rules not processed for user `df88788d6691436c983cdb53f5e4c53e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:45.175620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f8635000-1566-4dc8-974b-e431b3cf8700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:45.227053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29815b0-4201-4e9e-88eb-0d7f3ebc1ea5 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:45.227338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29815b0-4201-4e9e-88eb-0d7f3ebc1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:45.227826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29815b0-4201-4e9e-88eb-0d7f3ebc1ea5 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:45.229214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 702/1402] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:39:45.234508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618afc-2425-46d9-8842-1013dae18d39 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:45.234827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618afc-2425-46d9-8842-1013dae18d39 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:45.235270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f618afc-2425-46d9-8842-1013dae18d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:45.254818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-8f618afc-2425-46d9-8842-1013dae18d39 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:45.256611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8f618afc-2425-46d9-8842-1013dae18d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:45.257226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 701/1403] 10.222.0.60 () {58 vars in 1039 bytes} [Thu May 26 12:39:45 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:45.266915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 703/1404] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:39:45.268115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8635000-1566-4dc8-974b-e431b3cf8700 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:45.278682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8635000-1566-4dc8-974b-e431b3cf8700 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:45.284359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686050cc-c885-4aaa-b358-e8145e1763dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:45.285023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686050cc-c885-4aaa-b358-e8145e1763dd service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:45.285328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686050cc-c885-4aaa-b358-e8145e1763dd service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:45.285608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686050cc-c885-4aaa-b358-e8145e1763dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:45.296448 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686050cc-c885-4aaa-b358-e8145e1763dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:45.298200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686050cc-c885-4aaa-b358-e8145e1763dd service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:45.310031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 702/1405] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:39:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:39:45.312346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f618afc-2425-46d9-8842-1013dae18d39 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:45.326267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f618afc-2425-46d9-8842-1013dae18d39 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:45.336501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31122034-ae27-4a86-8fae-4a1bd9d6faf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:45.337203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31122034-ae27-4a86-8fae-4a1bd9d6faf6 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:45.337486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31122034-ae27-4a86-8fae-4a1bd9d6faf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:45.337759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31122034-ae27-4a86-8fae-4a1bd9d6faf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:45.343312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:45.347466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31122034-ae27-4a86-8fae-4a1bd9d6faf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:45.349135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31122034-ae27-4a86-8fae-4a1bd9d6faf6 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:45.360799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 704/1406] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:39:47.974067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc753d-7da7-403e-86e2-49c6d456f2dc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:47.978451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc753d-7da7-403e-86e2-49c6d456f2dc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:47.978451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dc753d-7da7-403e-86e2-49c6d456f2dc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:47.978451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 703/1407] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:39:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:39:47.983395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d51067-d3bf-47b6-8514-ce36a904af39 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:47.983852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d51067-d3bf-47b6-8514-ce36a904af39 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:47.983962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d51067-d3bf-47b6-8514-ce36a904af39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:48.003977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-21d51067-d3bf-47b6-8514-ce36a904af39 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:39:48.006173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-21d51067-d3bf-47b6-8514-ce36a904af39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:39:48.017945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 705/1408] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:39:48.063556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc753d-7da7-403e-86e2-49c6d456f2dc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:39:48.079401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dc753d-7da7-403e-86e2-49c6d456f2dc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:39:48.085501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ba727-ff3a-4b58-a711-32a0679cd111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:39:48.086163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba727-ff3a-4b58-a711-32a0679cd111 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:39:48.086446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba727-ff3a-4b58-a711-32a0679cd111 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:39:48.086813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ba727-ff3a-4b58-a711-32a0679cd111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:39:48.098506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ba727-ff3a-4b58-a711-32a0679cd111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:39:48.100813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ba727-ff3a-4b58-a711-32a0679cd111 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:39:48.111829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 704/1409] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:39:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:39:57.998057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:39:58.106460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=42 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:11.088635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58458e-73a1-4ca3-9050-8d75fa5bc6e3 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:11.089248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58458e-73a1-4ca3-9050-8d75fa5bc6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:11.089248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58458e-73a1-4ca3-9050-8d75fa5bc6e3 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:11.090563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 706/1410] 10.222.0.60 () {54 vars in 918 bytes} [Thu May 26 12:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:11.095888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c498a3-a7d8-4d86-87d4-1472f8fde960 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:11.096391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c498a3-a7d8-4d86-87d4-1472f8fde960 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:11.096494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c498a3-a7d8-4d86-87d4-1472f8fde960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:11.118145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-55c498a3-a7d8-4d86-87d4-1472f8fde960 None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:11.119380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-55c498a3-a7d8-4d86-87d4-1472f8fde960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:11.127810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 705/1411] 10.222.0.60 () {58 vars in 1015 bytes} [Thu May 26 12:40:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:11.143067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53f44-2684-4405-831a-cf74d1fe55b5 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:11.143371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53f44-2684-4405-831a-cf74d1fe55b5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:11.143671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a53f44-2684-4405-831a-cf74d1fe55b5 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:11.145314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 707/1412] 10.222.0.60 () {54 vars in 918 bytes} [Thu May 26 12:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:11.150981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85263d1d-d497-4654-8b8b-d9af079968be None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:11.151273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85263d1d-d497-4654-8b8b-d9af079968be None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:11.151552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85263d1d-d497-4654-8b8b-d9af079968be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:11.171771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-85263d1d-d497-4654-8b8b-d9af079968be None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:11.173002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-85263d1d-d497-4654-8b8b-d9af079968be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:11.183356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 706/1413] 10.222.0.60 () {58 vars in 1015 bytes} [Thu May 26 12:40:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:14.001656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea9841-cd8d-48d9-b3e9-a4ccd2245662 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:14.002253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea9841-cd8d-48d9-b3e9-a4ccd2245662 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:14.002253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea9841-cd8d-48d9-b3e9-a4ccd2245662 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:14.003630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:14.009464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8d54f-0379-4343-a0f7-12d742e9a41f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:14.009984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8d54f-0379-4343-a0f7-12d742e9a41f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:14.010081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8d54f-0379-4343-a0f7-12d742e9a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:14.028870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-deb8d54f-0379-4343-a0f7-12d742e9a41f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:14.030083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-deb8d54f-0379-4343-a0f7-12d742e9a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:14.039100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:14.083282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea9841-cd8d-48d9-b3e9-a4ccd2245662 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:14.098451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea9841-cd8d-48d9-b3e9-a4ccd2245662 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:14.104398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a2926-b004-434f-829b-347734ffe983 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:14.113196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a2926-b004-434f-829b-347734ffe983 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:14.113196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a2926-b004-434f-829b-347734ffe983 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:14.113196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a2926-b004-434f-829b-347734ffe983 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:14.114448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a2926-b004-434f-829b-347734ffe983 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:14.116820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a2926-b004-434f-829b-347734ffe983 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:14.127360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 709/1416] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:15.128504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b71d65-6725-4acf-91d1-d98c6b36d12f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.129103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b71d65-6725-4acf-91d1-d98c6b36d12f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.129103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b71d65-6725-4acf-91d1-d98c6b36d12f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.130424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:15.136342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d58a8-30e9-4f25-99ec-0dde7af98446 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.136817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d58a8-30e9-4f25-99ec-0dde7af98446 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.136913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d58a8-30e9-4f25-99ec-0dde7af98446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.155939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-8d9d58a8-30e9-4f25-99ec-0dde7af98446 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:15.157132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8d9d58a8-30e9-4f25-99ec-0dde7af98446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:15.165210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:15.321938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b71d65-6725-4acf-91d1-d98c6b36d12f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:15.336361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b71d65-6725-4acf-91d1-d98c6b36d12f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:15.342484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae024c3-d8bc-4095-8696-47daf6dfc068 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:15.343243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae024c3-d8bc-4095-8696-47daf6dfc068 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:15.343526 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae024c3-d8bc-4095-8696-47daf6dfc068 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:15.343801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae024c3-d8bc-4095-8696-47daf6dfc068 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:15.353618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae024c3-d8bc-4095-8696-47daf6dfc068 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:15.355274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae024c3-d8bc-4095-8696-47daf6dfc068 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:15.365981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 709/1419] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:16.325383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979d70-1fae-4f0b-a565-9d7d4bb4b9ba None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.325950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979d70-1fae-4f0b-a565-9d7d4bb4b9ba None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.325950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979d70-1fae-4f0b-a565-9d7d4bb4b9ba None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.327355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:16.332501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5909bfa-7268-4b03-95d5-4a166b96488e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.332969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5909bfa-7268-4b03-95d5-4a166b96488e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.333074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5909bfa-7268-4b03-95d5-4a166b96488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.351576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d5909bfa-7268-4b03-95d5-4a166b96488e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:16.352781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d5909bfa-7268-4b03-95d5-4a166b96488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:16.360560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:16.517961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5979d70-1fae-4f0b-a565-9d7d4bb4b9ba None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:16.535585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5979d70-1fae-4f0b-a565-9d7d4bb4b9ba None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:16.542824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7411d1-c737-418c-b84d-4188ab447879 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:16.543869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7411d1-c737-418c-b84d-4188ab447879 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:16.543869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7411d1-c737-418c-b84d-4188ab447879 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:16.544085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7411d1-c737-418c-b84d-4188ab447879 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:16.553678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7411d1-c737-418c-b84d-4188ab447879 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:16.555361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7411d1-c737-418c-b84d-4188ab447879 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:16.565338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 712/1422] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:17.504754 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b369-278c-4174-9c5f-a60b77f552b9 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:17.505218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b369-278c-4174-9c5f-a60b77f552b9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:17.506412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7b369-278c-4174-9c5f-a60b77f552b9 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:17.507200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:40:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:17.512465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c84f-1118-4629-8269-e0f252e8d75a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:17.512911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c84f-1118-4629-8269-e0f252e8d75a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:17.513064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2c84f-1118-4629-8269-e0f252e8d75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:17.532167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-fbc2c84f-1118-4629-8269-e0f252e8d75a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:17.535152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fbc2c84f-1118-4629-8269-e0f252e8d75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:17.542462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:40:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:17.697302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7b369-278c-4174-9c5f-a60b77f552b9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:17.713029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7b369-278c-4174-9c5f-a60b77f552b9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:17.718980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7afbb68-b6ce-43d2-86e7-6f2fdd881a0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:17.719651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afbb68-b6ce-43d2-86e7-6f2fdd881a0e service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:17.719935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afbb68-b6ce-43d2-86e7-6f2fdd881a0e service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:17.720207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7afbb68-b6ce-43d2-86e7-6f2fdd881a0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:17.729057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afbb68-b6ce-43d2-86e7-6f2fdd881a0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:17.730731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7afbb68-b6ce-43d2-86e7-6f2fdd881a0e service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:17.740712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 712/1425] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:18.664236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23130-8933-4755-8fdf-fd58ee95d982 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:18.664828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23130-8933-4755-8fdf-fd58ee95d982 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:18.664828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd23130-8933-4755-8fdf-fd58ee95d982 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:18.666226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:40:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:18.671371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb69f33-e36c-4cf0-abe0-5842cf2fd1e5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:18.671825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb69f33-e36c-4cf0-abe0-5842cf2fd1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:18.671923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb69f33-e36c-4cf0-abe0-5842cf2fd1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:18.691086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cdb69f33-e36c-4cf0-abe0-5842cf2fd1e5 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:18.692282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cdb69f33-e36c-4cf0-abe0-5842cf2fd1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:18.700258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:18.854155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd23130-8933-4755-8fdf-fd58ee95d982 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:18.868653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd23130-8933-4755-8fdf-fd58ee95d982 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:18.874043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce5e20-c78c-484a-be42-6f26569e02b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:18.874721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5e20-c78c-484a-be42-6f26569e02b2 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:18.875006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5e20-c78c-484a-be42-6f26569e02b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:18.875281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce5e20-c78c-484a-be42-6f26569e02b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:18.884318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce5e20-c78c-484a-be42-6f26569e02b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:18.885905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce5e20-c78c-484a-be42-6f26569e02b2 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:18.896290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 715/1428] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:19.838897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e528e8-ec97-46fe-bf2b-511ac2922e6e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:19.839483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e528e8-ec97-46fe-bf2b-511ac2922e6e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:19.839483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e528e8-ec97-46fe-bf2b-511ac2922e6e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:19.840829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:19.845860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ee99b-6d44-4789-9476-eb0ca88b00ce None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:19.846287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ee99b-6d44-4789-9476-eb0ca88b00ce None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:19.846465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013ee99b-6d44-4789-9476-eb0ca88b00ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:19.864320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-013ee99b-6d44-4789-9476-eb0ca88b00ce None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:19.866066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-013ee99b-6d44-4789-9476-eb0ca88b00ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:19.873881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:20.026658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e528e8-ec97-46fe-bf2b-511ac2922e6e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:20.041843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e528e8-ec97-46fe-bf2b-511ac2922e6e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:20.047097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51bd72f-8b90-479e-992b-7a3ceff86341 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:20.047736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd72f-8b90-479e-992b-7a3ceff86341 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:20.048012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd72f-8b90-479e-992b-7a3ceff86341 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:20.048281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51bd72f-8b90-479e-992b-7a3ceff86341 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:20.058484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bd72f-8b90-479e-992b-7a3ceff86341 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:20.060103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51bd72f-8b90-479e-992b-7a3ceff86341 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:20.070253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 715/1431] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:21.023534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab985-1fb9-4420-a2bf-f4857b34a926 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:21.024124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab985-1fb9-4420-a2bf-f4857b34a926 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:21.024124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ab985-1fb9-4420-a2bf-f4857b34a926 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:21.025631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:21.030908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49b2a-29bb-431b-99fa-3039acef102a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:21.031390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49b2a-29bb-431b-99fa-3039acef102a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:21.031521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec49b2a-29bb-431b-99fa-3039acef102a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:21.050554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-eec49b2a-29bb-431b-99fa-3039acef102a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:21.051773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eec49b2a-29bb-431b-99fa-3039acef102a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:21.060212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:21.213751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ab985-1fb9-4420-a2bf-f4857b34a926 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:21.234032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ab985-1fb9-4420-a2bf-f4857b34a926 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:21.239380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e92a65-a4aa-41ab-b803-1d0e90074d48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:21.240027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92a65-a4aa-41ab-b803-1d0e90074d48 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:21.240896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92a65-a4aa-41ab-b803-1d0e90074d48 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:21.241729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e92a65-a4aa-41ab-b803-1d0e90074d48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:21.250485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e92a65-a4aa-41ab-b803-1d0e90074d48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:21.252083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e92a65-a4aa-41ab-b803-1d0e90074d48 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:21.262509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 718/1434] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:22.248100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa820-5219-4850-b35a-59787f2f82ef None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:22.248688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa820-5219-4850-b35a-59787f2f82ef None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:22.248688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daa820-5219-4850-b35a-59787f2f82ef None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:22.250042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:22.255371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf99111-acac-4af7-bad0-458b3a48ccf2 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:22.255885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf99111-acac-4af7-bad0-458b3a48ccf2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:22.256016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf99111-acac-4af7-bad0-458b3a48ccf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:22.276409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-bcf99111-acac-4af7-bad0-458b3a48ccf2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:22.277631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bcf99111-acac-4af7-bad0-458b3a48ccf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:22.285579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:22.462809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daa820-5219-4850-b35a-59787f2f82ef None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:22.478025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daa820-5219-4850-b35a-59787f2f82ef None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:22.483627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf643ed-5541-42df-8afa-04423d0ac584 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:22.484305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf643ed-5541-42df-8afa-04423d0ac584 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:22.484587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf643ed-5541-42df-8afa-04423d0ac584 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:22.484864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf643ed-5541-42df-8afa-04423d0ac584 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:22.493819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf643ed-5541-42df-8afa-04423d0ac584 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:22.495450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf643ed-5541-42df-8afa-04423d0ac584 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:22.505471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 718/1437] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:23.450418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dc0a6-7b26-4b94-bf88-1f88f7a1af5f None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:23.451085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dc0a6-7b26-4b94-bf88-1f88f7a1af5f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:23.451085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dc0a6-7b26-4b94-bf88-1f88f7a1af5f None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:23.452389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:23.457705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3cd74-8119-4630-ae33-80d83ce55d2d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:23.458361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3cd74-8119-4630-ae33-80d83ce55d2d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:23.458361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3cd74-8119-4630-ae33-80d83ce55d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:23.477969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fee3cd74-8119-4630-ae33-80d83ce55d2d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:23.479208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fee3cd74-8119-4630-ae33-80d83ce55d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:23.487183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:23.644546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dc0a6-7b26-4b94-bf88-1f88f7a1af5f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:23.660826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dc0a6-7b26-4b94-bf88-1f88f7a1af5f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:23.668450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa04ebc0-9a7b-4b5a-850d-02aba04dfc4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:23.669146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04ebc0-9a7b-4b5a-850d-02aba04dfc4f service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:23.669428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04ebc0-9a7b-4b5a-850d-02aba04dfc4f service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:23.669702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa04ebc0-9a7b-4b5a-850d-02aba04dfc4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:23.678602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04ebc0-9a7b-4b5a-850d-02aba04dfc4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:23.680193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa04ebc0-9a7b-4b5a-850d-02aba04dfc4f service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:23.690197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 721/1440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:25.830820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88508f-cdb3-4f57-8d9e-950d090da9ac None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:25.831400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88508f-cdb3-4f57-8d9e-950d090da9ac None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:25.831400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88508f-cdb3-4f57-8d9e-950d090da9ac None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:25.832753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:25.839768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3812b-15bc-47d4-8c94-4f58643b1112 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:25.840240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3812b-15bc-47d4-8c94-4f58643b1112 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:25.840335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3812b-15bc-47d4-8c94-4f58643b1112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:25.858624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-fec3812b-15bc-47d4-8c94-4f58643b1112 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:25.859918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fec3812b-15bc-47d4-8c94-4f58643b1112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:25.868071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:25.906678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88508f-cdb3-4f57-8d9e-950d090da9ac None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:25.918063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88508f-cdb3-4f57-8d9e-950d090da9ac None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:25.921571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cffc3e8-8b6d-441e-ac67-a0b03829213d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:25.922215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc3e8-8b6d-441e-ac67-a0b03829213d service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:25.922495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc3e8-8b6d-441e-ac67-a0b03829213d service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:25.922813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffc3e8-8b6d-441e-ac67-a0b03829213d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:25.933192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffc3e8-8b6d-441e-ac67-a0b03829213d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:25.934657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cffc3e8-8b6d-441e-ac67-a0b03829213d service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:25.945834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 721/1443] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:28.348399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df04a45-5993-465a-aeed-b53178bb5bcf None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:28.349145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df04a45-5993-465a-aeed-b53178bb5bcf None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:28.349615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df04a45-5993-465a-aeed-b53178bb5bcf None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:28.352257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:28.358714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68269426-ec96-4a89-a589-4981711e6a79 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:28.359191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68269426-ec96-4a89-a589-4981711e6a79 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:28.359301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68269426-ec96-4a89-a589-4981711e6a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:28.378419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-68269426-ec96-4a89-a589-4981711e6a79 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:28.379655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-68269426-ec96-4a89-a589-4981711e6a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:28.387562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:28.432114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df04a45-5993-465a-aeed-b53178bb5bcf None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:28.442839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df04a45-5993-465a-aeed-b53178bb5bcf None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:28.446577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7348da2-406c-4a3b-83f6-089389b00196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:28.447229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7348da2-406c-4a3b-83f6-089389b00196 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:28.447506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7348da2-406c-4a3b-83f6-089389b00196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:28.447779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7348da2-406c-4a3b-83f6-089389b00196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:28.456941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7348da2-406c-4a3b-83f6-089389b00196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:28.458425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7348da2-406c-4a3b-83f6-089389b00196 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:28.468885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 724/1446] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:31.121997 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3b304-875b-4168-a2ed-ef92c18420ca None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:31.122549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3b304-875b-4168-a2ed-ef92c18420ca None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:31.122549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3b304-875b-4168-a2ed-ef92c18420ca None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:31.123970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:31.129254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466b18-7064-46d5-bc3c-946c04512579 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:31.129692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466b18-7064-46d5-bc3c-946c04512579 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:31.129799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39466b18-7064-46d5-bc3c-946c04512579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:31.148537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-39466b18-7064-46d5-bc3c-946c04512579 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:31.149735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-39466b18-7064-46d5-bc3c-946c04512579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:31.157422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:31.196530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3b304-875b-4168-a2ed-ef92c18420ca None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:31.207166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3b304-875b-4168-a2ed-ef92c18420ca None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:31.211168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84358f91-ce63-42d8-a8a0-16158b54f0b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:31.211806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84358f91-ce63-42d8-a8a0-16158b54f0b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:31.212119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84358f91-ce63-42d8-a8a0-16158b54f0b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:31.212428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84358f91-ce63-42d8-a8a0-16158b54f0b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:31.221828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84358f91-ce63-42d8-a8a0-16158b54f0b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:31.223297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84358f91-ce63-42d8-a8a0-16158b54f0b8 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:31.233351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 724/1449] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:33.622877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659af9-566c-4c01-96f3-77d5b98c0c63 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:33.623437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659af9-566c-4c01-96f3-77d5b98c0c63 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:33.623437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e659af9-566c-4c01-96f3-77d5b98c0c63 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:33.625048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:33.630759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf41d2-a0ee-43c8-a076-d167f62905cf None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:33.631520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf41d2-a0ee-43c8-a076-d167f62905cf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:33.631820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf41d2-a0ee-43c8-a076-d167f62905cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:33.649911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-2cdf41d2-a0ee-43c8-a076-d167f62905cf None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:33.651229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2cdf41d2-a0ee-43c8-a076-d167f62905cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:33.659140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:33.699478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659af9-566c-4c01-96f3-77d5b98c0c63 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:33.710841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e659af9-566c-4c01-96f3-77d5b98c0c63 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:33.714514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed3989-e451-4843-8266-625f2592a2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:33.715315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed3989-e451-4843-8266-625f2592a2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:33.715647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed3989-e451-4843-8266-625f2592a2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:33.715974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed3989-e451-4843-8266-625f2592a2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:33.726734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed3989-e451-4843-8266-625f2592a2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:33.728164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed3989-e451-4843-8266-625f2592a2c3 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:33.737949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 727/1452] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:36.064211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa1bf-9d06-4835-a457-d43d8e3f443d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:36.064786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa1bf-9d06-4835-a457-d43d8e3f443d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:36.064786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893fa1bf-9d06-4835-a457-d43d8e3f443d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:36.066157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:36.072129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524e1c-9bec-4fcd-be5f-4956e03db2be None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:36.072571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524e1c-9bec-4fcd-be5f-4956e03db2be None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:36.072668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7524e1c-9bec-4fcd-be5f-4956e03db2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:36.090975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-c7524e1c-9bec-4fcd-be5f-4956e03db2be None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:36.092182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c7524e1c-9bec-4fcd-be5f-4956e03db2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:36.100045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:36.137954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fa1bf-9d06-4835-a457-d43d8e3f443d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:36.149054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893fa1bf-9d06-4835-a457-d43d8e3f443d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:36.152492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1eb83-8d86-4d09-b59e-2ad7793eef91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:36.153129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1eb83-8d86-4d09-b59e-2ad7793eef91 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:36.153407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1eb83-8d86-4d09-b59e-2ad7793eef91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:36.153680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1eb83-8d86-4d09-b59e-2ad7793eef91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:36.162460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1eb83-8d86-4d09-b59e-2ad7793eef91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:36.164176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1eb83-8d86-4d09-b59e-2ad7793eef91 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:36.173369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 727/1455] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:38.514658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad4358-decf-4294-87b2-3ec3521c9e1f None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:38.515380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad4358-decf-4294-87b2-3ec3521c9e1f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:38.515380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad4358-decf-4294-87b2-3ec3521c9e1f None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:38.516587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:38.523082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020b9f3-4ca1-49ad-b51a-6c1b367e9b2f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:38.523593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020b9f3-4ca1-49ad-b51a-6c1b367e9b2f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:38.523689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020b9f3-4ca1-49ad-b51a-6c1b367e9b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:38.542289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0020b9f3-4ca1-49ad-b51a-6c1b367e9b2f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:38.543463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0020b9f3-4ca1-49ad-b51a-6c1b367e9b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:38.551339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:38.590653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad4358-decf-4294-87b2-3ec3521c9e1f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:38.601993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad4358-decf-4294-87b2-3ec3521c9e1f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:38.605512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c47e-2409-4351-acfc-fbd3dfe3a37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:38.606167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c47e-2409-4351-acfc-fbd3dfe3a37e service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:38.606447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c47e-2409-4351-acfc-fbd3dfe3a37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:38.606753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c47e-2409-4351-acfc-fbd3dfe3a37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:38.616400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c47e-2409-4351-acfc-fbd3dfe3a37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:38.617828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c47e-2409-4351-acfc-fbd3dfe3a37e service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:38.627863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 730/1458] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:41.005009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53e6e-8087-4c46-a9d5-10a030aa8668 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:41.005582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53e6e-8087-4c46-a9d5-10a030aa8668 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:41.005582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e53e6e-8087-4c46-a9d5-10a030aa8668 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:41.007172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:41.012839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36ef8-9135-48c2-92d5-a9a6690b8ab7 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:41.013311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36ef8-9135-48c2-92d5-a9a6690b8ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:41.013419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c36ef8-9135-48c2-92d5-a9a6690b8ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:41.019441 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=70 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:41.033380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f8c36ef8-9135-48c2-92d5-a9a6690b8ab7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:41.034632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f8c36ef8-9135-48c2-92d5-a9a6690b8ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:41.047131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:41.086036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53e6e-8087-4c46-a9d5-10a030aa8668 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:41.091653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=73 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:41.097686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e53e6e-8087-4c46-a9d5-10a030aa8668 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:41.102268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0c9f9-5ddc-410b-a092-4461cd677c8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:41.103869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c9f9-5ddc-410b-a092-4461cd677c8a service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:41.103869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c9f9-5ddc-410b-a092-4461cd677c8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:41.103869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0c9f9-5ddc-410b-a092-4461cd677c8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:41.112692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0c9f9-5ddc-410b-a092-4461cd677c8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:41.114118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0c9f9-5ddc-410b-a092-4461cd677c8a service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:41.125469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 730/1461] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:43.456331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1454e6-e44b-434e-a90c-f4939f146931 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:43.456914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1454e6-e44b-434e-a90c-f4939f146931 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:43.456914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1454e6-e44b-434e-a90c-f4939f146931 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:43.458245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:43.465033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8f71-8ad1-4b19-b712-e92274c126b2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:43.465622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8f71-8ad1-4b19-b712-e92274c126b2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:43.465622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc8f71-8ad1-4b19-b712-e92274c126b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:43.486100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d7dc8f71-8ad1-4b19-b712-e92274c126b2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:43.487400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7dc8f71-8ad1-4b19-b712-e92274c126b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:43.496251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:40:43.539774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1454e6-e44b-434e-a90c-f4939f146931 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:43.550980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1454e6-e44b-434e-a90c-f4939f146931 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:43.555673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb987d-b0cd-4e20-b71f-6454d1ff8ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:43.556319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb987d-b0cd-4e20-b71f-6454d1ff8ced service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:43.556599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb987d-b0cd-4e20-b71f-6454d1ff8ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:43.556869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb987d-b0cd-4e20-b71f-6454d1ff8ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:43.566153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb987d-b0cd-4e20-b71f-6454d1ff8ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:43.567613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfb987d-b0cd-4e20-b71f-6454d1ff8ced service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:43.577759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 733/1464] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:45.943905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6a36-817b-4591-a7a9-bd304466f226 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.944426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6a36-817b-4591-a7a9-bd304466f226 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.944716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e6a36-817b-4591-a7a9-bd304466f226 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.946126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:45.951622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac96d32-0f28-467e-8c6d-9ed05e6d401e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:45.952096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac96d32-0f28-467e-8c6d-9ed05e6d401e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:45.952214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac96d32-0f28-467e-8c6d-9ed05e6d401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:45.970440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7ac96d32-0f28-467e-8c6d-9ed05e6d401e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:45.971695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7ac96d32-0f28-467e-8c6d-9ed05e6d401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:45.980175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:46.016179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e6a36-817b-4591-a7a9-bd304466f226 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:46.027841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e6a36-817b-4591-a7a9-bd304466f226 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:46.031507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1c397-ce4c-4640-83a5-b6d1aa101b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:46.032154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1c397-ce4c-4640-83a5-b6d1aa101b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:46.032430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1c397-ce4c-4640-83a5-b6d1aa101b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:46.032702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1c397-ce4c-4640-83a5-b6d1aa101b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:46.042964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1c397-ce4c-4640-83a5-b6d1aa101b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:46.044378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e1c397-ce4c-4640-83a5-b6d1aa101b75 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:46.053983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 733/1467] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:48.303077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7555-7b23-47cd-8a08-42d7ebac0da0 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:48.303702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7555-7b23-47cd-8a08-42d7ebac0da0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:48.303996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7555-7b23-47cd-8a08-42d7ebac0da0 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:48.305409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:40:48.310970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae78a8-65ed-4ae6-a2a0-47d5a27cfaaa None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:48.311442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae78a8-65ed-4ae6-a2a0-47d5a27cfaaa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:48.311549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae78a8-65ed-4ae6-a2a0-47d5a27cfaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:48.330143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-72ae78a8-65ed-4ae6-a2a0-47d5a27cfaaa None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:40:48.331384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-72ae78a8-65ed-4ae6-a2a0-47d5a27cfaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:40:48.340243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:40:48.377463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b7555-7b23-47cd-8a08-42d7ebac0da0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:40:48.388465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b7555-7b23-47cd-8a08-42d7ebac0da0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:40:48.391995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1320f4e-d8a1-4d8d-8527-35c40f88ef38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:40:48.392634 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320f4e-d8a1-4d8d-8527-35c40f88ef38 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:40:48.392913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320f4e-d8a1-4d8d-8527-35c40f88ef38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:40:48.393228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320f4e-d8a1-4d8d-8527-35c40f88ef38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:40:48.403780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320f4e-d8a1-4d8d-8527-35c40f88ef38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:40:48.405251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320f4e-d8a1-4d8d-8527-35c40f88ef38 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:40:48.415688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 736/1470] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:40:58.324844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=17 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:40:58.410710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=17 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:22.405764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280095de-3df0-428b-949e-60ee01d81736 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:22.406369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280095de-3df0-428b-949e-60ee01d81736 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:22.406369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280095de-3df0-428b-949e-60ee01d81736 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:22.407732 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 735/1471] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:41:22.412941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7db4-2734-49c5-a86b-5cc0dc240568 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:22.413395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7db4-2734-49c5-a86b-5cc0dc240568 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:22.413718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7db4-2734-49c5-a86b-5cc0dc240568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:22.432461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-79fc7db4-2734-49c5-a86b-5cc0dc240568 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:22.433702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-79fc7db4-2734-49c5-a86b-5cc0dc240568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:22.441634 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 737/1472] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:22.489851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d4b94-7b79-427c-b3c2-2dc089d998a6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:22.490163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d4b94-7b79-427c-b3c2-2dc089d998a6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:22.490444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d4b94-7b79-427c-b3c2-2dc089d998a6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:22.492395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 736/1473] 10.222.0.60 () {54 vars in 962 bytes} [Thu May 26 12:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:41:22.497260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959bad7-8a5e-46f9-b484-7c8c02210173 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:22.497549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959bad7-8a5e-46f9-b484-7c8c02210173 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:22.497826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959bad7-8a5e-46f9-b484-7c8c02210173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:22.516359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-1959bad7-8a5e-46f9-b484-7c8c02210173 None None] MFA Rules not processed for user `175b409f5ee842ddb9f5f3468a6a461b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:22.517552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-1959bad7-8a5e-46f9-b484-7c8c02210173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:22.524534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 738/1474] 10.222.0.60 () {58 vars in 1059 bytes} [Thu May 26 12:41:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:22.533717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d4b94-7b79-427c-b3c2-2dc089d998a6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:22.542475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d4b94-7b79-427c-b3c2-2dc089d998a6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:22.545918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f33f0ea-0d8a-48ca-b09b-8849f2ea5993 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:22.546599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f0ea-0d8a-48ca-b09b-8849f2ea5993 service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:22.546908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f0ea-0d8a-48ca-b09b-8849f2ea5993 service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:22.547184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f33f0ea-0d8a-48ca-b09b-8849f2ea5993 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:22.556999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33f0ea-0d8a-48ca-b09b-8849f2ea5993 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:22.558450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f33f0ea-0d8a-48ca-b09b-8849f2ea5993 service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:22.567919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 737/1475] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:24.912211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed437-ae7e-4733-afe4-e5840719b1f6 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:24.912784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed437-ae7e-4733-afe4-e5840719b1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:24.912784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed437-ae7e-4733-afe4-e5840719b1f6 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:24.914699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 739/1476] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:41:24.919898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751a01-f6d6-4459-90c6-106eb8b910df None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:24.920354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751a01-f6d6-4459-90c6-106eb8b910df None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:24.920460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae751a01-f6d6-4459-90c6-106eb8b910df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:24.939363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ae751a01-f6d6-4459-90c6-106eb8b910df None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:24.940559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ae751a01-f6d6-4459-90c6-106eb8b910df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:24.948302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 738/1477] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:24.971062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed437-ae7e-4733-afe4-e5840719b1f6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:24.984039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed437-ae7e-4733-afe4-e5840719b1f6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:24.988416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc6b306-d46f-42b4-84a9-3f9c7df7b897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:24.989061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6b306-d46f-42b4-84a9-3f9c7df7b897 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:24.989340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6b306-d46f-42b4-84a9-3f9c7df7b897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:24.989607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6b306-d46f-42b4-84a9-3f9c7df7b897 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:24.990330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6b306-d46f-42b4-84a9-3f9c7df7b897 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:24.992888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING py.warnings [None req-1cc6b306-d46f-42b4-84a9-3f9c7df7b897 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:41:24.992888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: warnings.warn(msg) May 26 12:41:24.992888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: May 26 12:41:24.994030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc6b306-d46f-42b4-84a9-3f9c7df7b897 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:25.012841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 740/1478] 10.222.0.60 () {56 vars in 1108 bytes} [Thu May 26 12:41:24 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:41:27.261907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fbfc5-a2f7-44a1-b0f3-99834bcc2505 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.262442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fbfc5-a2f7-44a1-b0f3-99834bcc2505 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.262442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487fbfc5-a2f7-44a1-b0f3-99834bcc2505 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.263852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 739/1479] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:41:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:41:27.269213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105f9b7-32f1-4e0c-8502-1b10022e715f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.269645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105f9b7-32f1-4e0c-8502-1b10022e715f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.269748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105f9b7-32f1-4e0c-8502-1b10022e715f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.287909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e105f9b7-32f1-4e0c-8502-1b10022e715f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:27.289896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e105f9b7-32f1-4e0c-8502-1b10022e715f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:27.297699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 741/1480] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:27.342730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fbfc5-a2f7-44a1-b0f3-99834bcc2505 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:27.356889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487fbfc5-a2f7-44a1-b0f3-99834bcc2505 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:27.362208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dac96c-b464-4a07-91dc-925e383911e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:27.362885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac96c-b464-4a07-91dc-925e383911e2 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:27.363169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac96c-b464-4a07-91dc-925e383911e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:27.363442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dac96c-b464-4a07-91dc-925e383911e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:27.372008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dac96c-b464-4a07-91dc-925e383911e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:27.373588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dac96c-b464-4a07-91dc-925e383911e2 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:27.383787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 740/1481] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:29.823543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5702de-9b02-4ce4-b8ce-1fb8b53a6788 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.824436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5702de-9b02-4ce4-b8ce-1fb8b53a6788 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.824620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5702de-9b02-4ce4-b8ce-1fb8b53a6788 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.826038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 742/1482] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:41:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:41:29.831666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cf40c-5266-4454-bbbe-042a8e928505 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.832112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cf40c-5266-4454-bbbe-042a8e928505 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.832208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7cf40c-5266-4454-bbbe-042a8e928505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.853006 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5f7cf40c-5266-4454-bbbe-042a8e928505 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:29.854198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5f7cf40c-5266-4454-bbbe-042a8e928505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:29.862046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 741/1483] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:29.898898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5702de-9b02-4ce4-b8ce-1fb8b53a6788 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:29.909493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5702de-9b02-4ce4-b8ce-1fb8b53a6788 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:29.913003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a843aa9-859d-4dbc-8fd5-782431b5c177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:29.914613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a843aa9-859d-4dbc-8fd5-782431b5c177 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:29.915037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a843aa9-859d-4dbc-8fd5-782431b5c177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:29.915446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a843aa9-859d-4dbc-8fd5-782431b5c177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:29.925224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a843aa9-859d-4dbc-8fd5-782431b5c177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:29.926675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a843aa9-859d-4dbc-8fd5-782431b5c177 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:29.936569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 743/1484] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:32.260816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90dc9-82ce-4280-b4f1-2ca161a455c0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:32.261492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90dc9-82ce-4280-b4f1-2ca161a455c0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:32.261604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f90dc9-82ce-4280-b4f1-2ca161a455c0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:32.264033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 742/1485] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:41:32.270684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693c6d-3662-4947-b58e-eb7e7ad3deab None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:32.271194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693c6d-3662-4947-b58e-eb7e7ad3deab None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:32.271309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b693c6d-3662-4947-b58e-eb7e7ad3deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:32.291598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5b693c6d-3662-4947-b58e-eb7e7ad3deab None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:32.292869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5b693c6d-3662-4947-b58e-eb7e7ad3deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:32.304335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 744/1486] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:32.342770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90dc9-82ce-4280-b4f1-2ca161a455c0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:32.353875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f90dc9-82ce-4280-b4f1-2ca161a455c0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:32.357480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b0e5f-1124-4730-868c-181ad366e496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:32.358123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0e5f-1124-4730-868c-181ad366e496 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:32.358405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0e5f-1124-4730-868c-181ad366e496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:32.358721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0e5f-1124-4730-868c-181ad366e496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:32.369393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b0e5f-1124-4730-868c-181ad366e496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:32.370871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b0e5f-1124-4730-868c-181ad366e496 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:32.380940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 743/1487] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:34.885883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afbc9-7245-40cd-9aa9-c7890f73e5ec None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.886519 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afbc9-7245-40cd-9aa9-c7890f73e5ec None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.886519 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347afbc9-7245-40cd-9aa9-c7890f73e5ec None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.887838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 745/1488] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:41:34.893190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617c3d5-b04e-486d-a104-48eee29abddc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.893647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617c3d5-b04e-486d-a104-48eee29abddc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.893762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617c3d5-b04e-486d-a104-48eee29abddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.911630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5617c3d5-b04e-486d-a104-48eee29abddc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:34.912822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5617c3d5-b04e-486d-a104-48eee29abddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:34.921107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 744/1489] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:34.962852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347afbc9-7245-40cd-9aa9-c7890f73e5ec None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:34.973755 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347afbc9-7245-40cd-9aa9-c7890f73e5ec None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:34.979236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4695fa1-3639-4e7d-a0bb-685ff74e755e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:34.979888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4695fa1-3639-4e7d-a0bb-685ff74e755e service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:34.980169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4695fa1-3639-4e7d-a0bb-685ff74e755e service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:34.980437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4695fa1-3639-4e7d-a0bb-685ff74e755e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:34.989896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4695fa1-3639-4e7d-a0bb-685ff74e755e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:34.991438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4695fa1-3639-4e7d-a0bb-685ff74e755e service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:35.002592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 746/1490] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:37.959109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773636cc-73c6-4fca-ae53-cbe6a708dbc1 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.959686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773636cc-73c6-4fca-ae53-cbe6a708dbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.959686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773636cc-73c6-4fca-ae53-cbe6a708dbc1 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.961786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 745/1491] 10.222.0.60 () {54 vars in 926 bytes} [Thu May 26 12:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:41:37.967747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40887e0e-c516-4fbe-b2eb-97ff7271a8f7 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:37.968287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40887e0e-c516-4fbe-b2eb-97ff7271a8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:37.968287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40887e0e-c516-4fbe-b2eb-97ff7271a8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:37.987431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-40887e0e-c516-4fbe-b2eb-97ff7271a8f7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:41:37.988672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-40887e0e-c516-4fbe-b2eb-97ff7271a8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:41:38.023547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 747/1492] 10.222.0.60 () {58 vars in 1023 bytes} [Thu May 26 12:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:41:38.036619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773636cc-73c6-4fca-ae53-cbe6a708dbc1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:41:38.049706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773636cc-73c6-4fca-ae53-cbe6a708dbc1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:41:38.053289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aeb0a7-7412-4fda-9915-42dffe61125e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:41:38.053936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb0a7-7412-4fda-9915-42dffe61125e service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:41:38.054211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb0a7-7412-4fda-9915-42dffe61125e service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:41:38.054481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aeb0a7-7412-4fda-9915-42dffe61125e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:41:38.063847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aeb0a7-7412-4fda-9915-42dffe61125e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:41:38.065268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aeb0a7-7412-4fda-9915-42dffe61125e service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:41:38.075767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 746/1493] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:41:47.981827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=33 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:41:48.071253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=33 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:35.985601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8786e1-e0f4-4ef8-84d9-c84b1453906e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:35.986241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8786e1-e0f4-4ef8-84d9-c84b1453906e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:35.986241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8786e1-e0f4-4ef8-84d9-c84b1453906e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.005060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-cb8786e1-e0f4-4ef8-84d9-c84b1453906e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:36.006247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cb8786e1-e0f4-4ef8-84d9-c84b1453906e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.015016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 748/1494] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:36.024329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684dcd4-6b56-45db-8c33-06bce30a71b5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.024847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684dcd4-6b56-45db-8c33-06bce30a71b5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.024990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684dcd4-6b56-45db-8c33-06bce30a71b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.043370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d684dcd4-6b56-45db-8c33-06bce30a71b5 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:36.044587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d684dcd4-6b56-45db-8c33-06bce30a71b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.052288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 747/1495] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:36.057627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8786e1-e0f4-4ef8-84d9-c84b1453906e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.067278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8786e1-e0f4-4ef8-84d9-c84b1453906e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.071781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.073251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.073538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.073814 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.074550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:43:36.074861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.075872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING py.warnings [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:36.075872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: warnings.warn(msg) May 26 12:43:36.075872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: May 26 12:43:36.076739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.089114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 749/1496] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:43:36.097474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684dcd4-6b56-45db-8c33-06bce30a71b5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.108308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684dcd4-6b56-45db-8c33-06bce30a71b5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.112967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.113631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.113911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.114183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.114985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.116790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:36.116790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 26 12:43:36.116790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: May 26 12:43:36.117956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.303553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 748/1497] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:43:36 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:43:36.308879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.319180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4012c2-27aa-4b0e-9126-0a2393155bbf admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.379680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.380359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.380636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.380926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.381644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.382707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING py.warnings [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:36.382707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: warnings.warn(msg) May 26 12:43:36.382707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: May 26 12:43:36.383936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.501925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 750/1498] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:43:36 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:43:36.506181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.517320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbdb4b4-2665-4548-9041-ce7e0737ba21 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.522552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.533691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.533691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.533691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.533691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.533691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:36.533691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 26 12:43:36.533691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: May 26 12:43:36.534306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.541575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 749/1499] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:36.545926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.555864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ed32a-88aa-4e86-b6af-5ed713c98a47 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.560627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a9586-1c6e-4ad6-80a6-9a03299c75c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.561282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9586-1c6e-4ad6-80a6-9a03299c75c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.561561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9586-1c6e-4ad6-80a6-9a03299c75c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.561831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a9586-1c6e-4ad6-80a6-9a03299c75c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.562573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a9586-1c6e-4ad6-80a6-9a03299c75c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.563575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING py.warnings [None req-703a9586-1c6e-4ad6-80a6-9a03299c75c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:36.563575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: warnings.warn(msg) May 26 12:43:36.563575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: May 26 12:43:36.564460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a9586-1c6e-4ad6-80a6-9a03299c75c5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.577840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 751/1500] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:43:36.581731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.592468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf62f25-a381-48f7-8a0a-49f132ce3703 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.597040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfbf8e-a280-4354-a163-a2492b48beb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.597918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfbf8e-a280-4354-a163-a2492b48beb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.598205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfbf8e-a280-4354-a163-a2492b48beb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.598479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfbf8e-a280-4354-a163-a2492b48beb7 admin admin] PATH_INFO: `/v3/projects/9855e3579a2645d5ae323b5fa503e58b/users/a65bcd60c6d64f529f71c3e6b303a635/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.614141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfbf8e-a280-4354-a163-a2492b48beb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9855e3579a2645d5ae323b5fa503e58b, user_id=a65bcd60c6d64f529f71c3e6b303a635, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.615235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-cfcfbf8e-a280-4354-a163-a2492b48beb7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:36.615235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 26 12:43:36.615235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: May 26 12:43:36.617126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfbf8e-a280-4354-a163-a2492b48beb7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:36.753559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 750/1501] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:43:36 2022] PUT /identity/v3/projects/9855e3579a2645d5ae323b5fa503e58b/users/a65bcd60c6d64f529f71c3e6b303a635/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:36.765257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da46df-68a2-405a-bfa0-dad5af51a80f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.765549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da46df-68a2-405a-bfa0-dad5af51a80f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.765831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da46df-68a2-405a-bfa0-dad5af51a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.809120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-85da46df-68a2-405a-bfa0-dad5af51a80f None None] MFA Rules not processed for user `a65bcd60c6d64f529f71c3e6b303a635`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:36.809120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-85da46df-68a2-405a-bfa0-dad5af51a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.863915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 752/1502] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:36.878283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a43a6-f09e-4406-b0cf-74f26cee9673 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.878604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a43a6-f09e-4406-b0cf-74f26cee9673 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.878886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a43a6-f09e-4406-b0cf-74f26cee9673 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.880271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 751/1503] 10.222.0.60 () {54 vars in 963 bytes} [Thu May 26 12:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:43:36.885827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8006c-4570-4139-b1c0-74ca4507de55 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.886109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8006c-4570-4139-b1c0-74ca4507de55 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.886383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8006c-4570-4139-b1c0-74ca4507de55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.905406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-76f8006c-4570-4139-b1c0-74ca4507de55 None None] MFA Rules not processed for user `17335764c3fd4960ab969211ca353b75`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:36.906667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-76f8006c-4570-4139-b1c0-74ca4507de55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:36.951658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:36.959298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 753/1504] 10.222.0.60 () {58 vars in 1060 bytes} [Thu May 26 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:36.968148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a43a6-f09e-4406-b0cf-74f26cee9673 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:36.979046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a43a6-f09e-4406-b0cf-74f26cee9673 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:36.982553 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c5f-0c3e-4b17-9855-4356a5b40833 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:36.983207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c5f-0c3e-4b17-9855-4356a5b40833 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:36.983487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c5f-0c3e-4b17-9855-4356a5b40833 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:36.983761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb7c5f-0c3e-4b17-9855-4356a5b40833 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:36.992593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb7c5f-0c3e-4b17-9855-4356a5b40833 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:36.994185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb7c5f-0c3e-4b17-9855-4356a5b40833 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:37.003757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 752/1505] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:43:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:37.049218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6ccd-93fc-40c8-bdbb-467a4307788d None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.049674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6ccd-93fc-40c8-bdbb-467a4307788d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.049782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b6ccd-93fc-40c8-bdbb-467a4307788d None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.051107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 754/1506] 10.222.0.60 () {52 vars in 829 bytes} [Thu May 26 12:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:43:37.054810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c5f-0c3e-4b17-9855-4356a5b40833 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:37.121489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb7c5f-0c3e-4b17-9855-4356a5b40833 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:37.126037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:37.126949 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.127224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.127512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] PATH_INFO: `/v3/users/a65bcd60c6d64f529f71c3e6b303a635` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.128747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a65bcd60c6d64f529f71c3e6b303a635)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:37.129789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:37.129789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 26 12:43:37.129789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: May 26 12:43:37.131019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:37.522632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a65bcd60c6d64f529f71c3e6b303a635'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.523291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a65bcd60c6d64f529f71c3e6b303a635'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.523923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a65bcd60c6d64f529f71c3e6b303a635'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.544471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a65bcd60c6d64f529f71c3e6b303a635'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.557933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a65bcd60c6d64f529f71c3e6b303a635'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:37.562381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:37.736529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 753/1507] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:43:37 2022] DELETE /identity/v3/users/a65bcd60c6d64f529f71c3e6b303a635 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:37.741110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb7e3-823a-4661-8428-c918ce330f95 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.741394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb7e3-823a-4661-8428-c918ce330f95 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.741669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfdb7e3-823a-4661-8428-c918ce330f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.759752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7cfdb7e3-823a-4661-8428-c918ce330f95 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:43:37.760956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7cfdb7e3-823a-4661-8428-c918ce330f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:37.822563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 755/1508] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:43:37.832127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:37.833562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:37.902403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aca4c1-1d1e-4615-a4ae-8728f9ecee27 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:37.906049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3004d8-1e5c-433d-a3a8-de630c56853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:37.906744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3004d8-1e5c-433d-a3a8-de630c56853f service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:37.907035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3004d8-1e5c-433d-a3a8-de630c56853f service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:37.907310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3004d8-1e5c-433d-a3a8-de630c56853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:37.920869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3004d8-1e5c-433d-a3a8-de630c56853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:37.922346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3004d8-1e5c-433d-a3a8-de630c56853f service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:37.933393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 754/1509] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:43:38.594949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdb7e3-823a-4661-8428-c918ce330f95 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:43:38.598261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7cfdb7e3-823a-4661-8428-c918ce330f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:43:38.609686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfdb7e3-823a-4661-8428-c918ce330f95 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:43:38.614389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:43:38.615306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:43:38.615585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:43:38.615858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] PATH_INFO: `/v3/projects/9855e3579a2645d5ae323b5fa503e58b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:43:38.617076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9855e3579a2645d5ae323b5fa503e58b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:43:38.618100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING py.warnings [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:43:38.618100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: warnings.warn(msg) May 26 12:43:38.618100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: May 26 12:43:38.619955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:43:38.759919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9855e3579a2645d5ae323b5fa503e58b', 'request_id': 'req-a162ba60-1fe5-4451-a8fc-8d9567507af4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.766462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9855e3579a2645d5ae323b5fa503e58b', 'request_id': 'req-a162ba60-1fe5-4451-a8fc-8d9567507af4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.867355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9855e3579a2645d5ae323b5fa503e58b', 'request_id': 'req-a162ba60-1fe5-4451-a8fc-8d9567507af4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.887137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] The token cache is being invalidate because project 9855e3579a2645d5ae323b5fa503e58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:43:38.887422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.888275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a162ba60-1fe5-4451-a8fc-8d9567507af4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:43:38.889879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 756/1510] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:43:38 2022] DELETE /identity/v3/projects/9855e3579a2645d5ae323b5fa503e58b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:43:47.928338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:43:48.883877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:24.082115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01958d-0db9-4305-b738-eed0e6d1f703 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:24.082744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01958d-0db9-4305-b738-eed0e6d1f703 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:24.082744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01958d-0db9-4305-b738-eed0e6d1f703 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:24.084114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:24.089242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c9f05-d6ae-47d1-b7e8-f7b8d959072b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:24.089730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c9f05-d6ae-47d1-b7e8-f7b8d959072b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:24.089834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c9f05-d6ae-47d1-b7e8-f7b8d959072b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:24.109510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b40c9f05-d6ae-47d1-b7e8-f7b8d959072b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:24.111409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b40c9f05-d6ae-47d1-b7e8-f7b8d959072b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:24.184729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:24.360048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01958d-0db9-4305-b738-eed0e6d1f703 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:24.361823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4c01958d-0db9-4305-b738-eed0e6d1f703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:24.439608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01958d-0db9-4305-b738-eed0e6d1f703 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:24.445445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328171e4-5930-413d-99b1-edfcb73d18ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:24.446115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328171e4-5930-413d-99b1-edfcb73d18ea service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:24.446398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328171e4-5930-413d-99b1-edfcb73d18ea service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:24.446706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328171e4-5930-413d-99b1-edfcb73d18ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:24.456195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328171e4-5930-413d-99b1-edfcb73d18ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:24.457815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328171e4-5930-413d-99b1-edfcb73d18ea service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:24.468104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 756/1513] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:25.368680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8200e1-ca15-4521-b2e9-5f36812580b4 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.369335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8200e1-ca15-4521-b2e9-5f36812580b4 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.369497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8200e1-ca15-4521-b2e9-5f36812580b4 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.371790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:45:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:25.378087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241711-d438-45e7-adb3-ca90770703f7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.378643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241711-d438-45e7-adb3-ca90770703f7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.378748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241711-d438-45e7-adb3-ca90770703f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.401296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-66241711-d438-45e7-adb3-ca90770703f7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:25.402517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-66241711-d438-45e7-adb3-ca90770703f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:25.410764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:25.571707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8200e1-ca15-4521-b2e9-5f36812580b4 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:25.586768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8200e1-ca15-4521-b2e9-5f36812580b4 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:25.599893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f417f7b-1a7e-4b84-8d25-c956b5d76127 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:25.600564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417f7b-1a7e-4b84-8d25-c956b5d76127 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.600843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417f7b-1a7e-4b84-8d25-c956b5d76127 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.601115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f417f7b-1a7e-4b84-8d25-c956b5d76127 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.610887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f417f7b-1a7e-4b84-8d25-c956b5d76127 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:25.613052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f417f7b-1a7e-4b84-8d25-c956b5d76127 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:25.624603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 759/1516] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:25.760798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd0ea-edab-439d-a13b-faa5662a3169 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.761083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd0ea-edab-439d-a13b-faa5662a3169 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.761356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dd0ea-edab-439d-a13b-faa5662a3169 None None] PATH_INFO: `/v3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.762777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 758/1517] 10.222.0.15 () {54 vars in 925 bytes} [Thu May 26 12:45:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:45:25.769528 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d6383-d842-4113-b1e8-77767bb5a6b4 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:25.769813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d6383-d842-4113-b1e8-77767bb5a6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:25.770091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d6383-d842-4113-b1e8-77767bb5a6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:25.789178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-8e1d6383-d842-4113-b1e8-77767bb5a6b4 None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:25.790419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8e1d6383-d842-4113-b1e8-77767bb5a6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:25.856483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 760/1518] 10.222.0.15 () {58 vars in 1015 bytes} [Thu May 26 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:35.395543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=37 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:35.616634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078491d6-0586-4683-8f3a-32906c24463d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:35.616836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078491d6-0586-4683-8f3a-32906c24463d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:35.617083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078491d6-0586-4683-8f3a-32906c24463d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:35.618494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 759/1519] 10.222.0.60 () {54 vars in 960 bytes} [Thu May 26 12:45:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:35.623618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b374d6d-748f-47fd-a086-af208cd01e44 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:35.624081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b374d6d-748f-47fd-a086-af208cd01e44 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:35.624177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b374d6d-748f-47fd-a086-af208cd01e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:35.645627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-0b374d6d-748f-47fd-a086-af208cd01e44 None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:35.646892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0b374d6d-748f-47fd-a086-af208cd01e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:35.655622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 761/1520] 10.222.0.60 () {58 vars in 1057 bytes} [Thu May 26 12:45:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:35.664131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078491d6-0586-4683-8f3a-32906c24463d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:35.677299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078491d6-0586-4683-8f3a-32906c24463d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:35.682101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d1491-b785-49b5-8ab9-2526229bd047 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:35.682769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1491-b785-49b5-8ab9-2526229bd047 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:35.683049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1491-b785-49b5-8ab9-2526229bd047 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:35.683320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d1491-b785-49b5-8ab9-2526229bd047 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:35.693226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1491-b785-49b5-8ab9-2526229bd047 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:35.694828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4d1491-b785-49b5-8ab9-2526229bd047 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:35.705258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 760/1521] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:36.934628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e81bd-27e8-4da6-8d2a-be67bceed0e3 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:36.935203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e81bd-27e8-4da6-8d2a-be67bceed0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:36.935203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e81bd-27e8-4da6-8d2a-be67bceed0e3 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:36.936615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:36.942735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7084a-b254-4ef6-a8b0-dd2290fa1d5c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:36.943201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7084a-b254-4ef6-a8b0-dd2290fa1d5c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:36.943306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7084a-b254-4ef6-a8b0-dd2290fa1d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:36.962097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bba7084a-b254-4ef6-a8b0-dd2290fa1d5c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:36.963360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bba7084a-b254-4ef6-a8b0-dd2290fa1d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:36.972332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:37.123661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e81bd-27e8-4da6-8d2a-be67bceed0e3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:37.138747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e81bd-27e8-4da6-8d2a-be67bceed0e3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:37.144416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f101c5-bea7-406a-b475-7fa945872adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:37.145057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f101c5-bea7-406a-b475-7fa945872adf service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:37.145337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f101c5-bea7-406a-b475-7fa945872adf service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:37.145610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f101c5-bea7-406a-b475-7fa945872adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:37.153770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f101c5-bea7-406a-b475-7fa945872adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:37.155648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f101c5-bea7-406a-b475-7fa945872adf service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:37.166518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 763/1524] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:38.069064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21c095-d390-4ce6-ac4a-430850cafcb6 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:38.069643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21c095-d390-4ce6-ac4a-430850cafcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:38.069643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21c095-d390-4ce6-ac4a-430850cafcb6 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:38.071172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 12:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:38.076072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363463-bd3c-41b9-83b9-0a56c64b5b51 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:38.076463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363463-bd3c-41b9-83b9-0a56c64b5b51 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:38.076647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5363463-bd3c-41b9-83b9-0a56c64b5b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:38.222421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-d5363463-bd3c-41b9-83b9-0a56c64b5b51 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:38.223659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d5363463-bd3c-41b9-83b9-0a56c64b5b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:38.231761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 12:45:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:38.386505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21c095-d390-4ce6-ac4a-430850cafcb6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:38.401076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21c095-d390-4ce6-ac4a-430850cafcb6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:38.406894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128bb85-822b-4ba1-bae1-2279d570de7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:38.407570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128bb85-822b-4ba1-bae1-2279d570de7d service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:38.407874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128bb85-822b-4ba1-bae1-2279d570de7d service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:38.408146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128bb85-822b-4ba1-bae1-2279d570de7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:38.416790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128bb85-822b-4ba1-bae1-2279d570de7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:38.418478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128bb85-822b-4ba1-bae1-2279d570de7d service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:38.428628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 763/1527] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:42.517500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ee00-5dc3-405b-adf9-0b57e4d74e79 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:42.518078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ee00-5dc3-405b-adf9-0b57e4d74e79 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:42.518078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6543ee00-5dc3-405b-adf9-0b57e4d74e79 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:42.519450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:45:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:42.524929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e8c2c-d2f2-404b-8e0a-2bf80535558a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:42.525370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e8c2c-d2f2-404b-8e0a-2bf80535558a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:42.525469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e8c2c-d2f2-404b-8e0a-2bf80535558a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:42.543755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-295e8c2c-d2f2-404b-8e0a-2bf80535558a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:42.544917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-295e8c2c-d2f2-404b-8e0a-2bf80535558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:42.553024 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:42.593652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543ee00-5dc3-405b-adf9-0b57e4d74e79 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:42.595552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6543ee00-5dc3-405b-adf9-0b57e4d74e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:42.657386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6543ee00-5dc3-405b-adf9-0b57e4d74e79 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:42.660961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd674ac-67d5-4172-8f83-c655065f2a71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:42.661622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd674ac-67d5-4172-8f83-c655065f2a71 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:42.661906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd674ac-67d5-4172-8f83-c655065f2a71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:42.662182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd674ac-67d5-4172-8f83-c655065f2a71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:42.671459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd674ac-67d5-4172-8f83-c655065f2a71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:42.673050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd674ac-67d5-4172-8f83-c655065f2a71 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:42.678088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:45:42.682977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 766/1530] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:44.910414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d88b3e-531e-43c1-a5a1-06839e55ebfc None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:44.911052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d88b3e-531e-43c1-a5a1-06839e55ebfc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:44.911052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d88b3e-531e-43c1-a5a1-06839e55ebfc None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:44.912391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:44.917906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4927c-9eb0-4047-a14d-7e4d38682b62 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:44.918406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4927c-9eb0-4047-a14d-7e4d38682b62 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:44.918512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4927c-9eb0-4047-a14d-7e4d38682b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:44.936851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-81a4927c-9eb0-4047-a14d-7e4d38682b62 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:44.938084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-81a4927c-9eb0-4047-a14d-7e4d38682b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:44.947576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:44.985452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d88b3e-531e-43c1-a5a1-06839e55ebfc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:44.987206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-27d88b3e-531e-43c1-a5a1-06839e55ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:45.000334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d88b3e-531e-43c1-a5a1-06839e55ebfc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:45.003929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef9754-cd04-4b3b-b309-08f5320048a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:45.004577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9754-cd04-4b3b-b309-08f5320048a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:45.004867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9754-cd04-4b3b-b309-08f5320048a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:45.005143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef9754-cd04-4b3b-b309-08f5320048a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:45.014618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9754-cd04-4b3b-b309-08f5320048a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:45.016719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef9754-cd04-4b3b-b309-08f5320048a8 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:45.026681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 766/1533] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:45:48.802659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65dc0-bc39-4a03-ae0c-930cc8f530e8 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:48.803220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65dc0-bc39-4a03-ae0c-930cc8f530e8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:48.803220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee65dc0-bc39-4a03-ae0c-930cc8f530e8 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:48.804580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:48.809822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044324c-c52b-45a9-bcd8-35eafac95af3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:48.810224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044324c-c52b-45a9-bcd8-35eafac95af3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:48.810390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044324c-c52b-45a9-bcd8-35eafac95af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:48.829165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4044324c-c52b-45a9-bcd8-35eafac95af3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:48.830384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4044324c-c52b-45a9-bcd8-35eafac95af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:48.838253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:49.112359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee65dc0-bc39-4a03-ae0c-930cc8f530e8 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:49.114041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3ee65dc0-bc39-4a03-ae0c-930cc8f530e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:49.171222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee65dc0-bc39-4a03-ae0c-930cc8f530e8 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:49.175407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5539314-aafd-4d56-99bd-1289bea17139 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:49.176054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539314-aafd-4d56-99bd-1289bea17139 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:49.176333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539314-aafd-4d56-99bd-1289bea17139 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:49.176607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5539314-aafd-4d56-99bd-1289bea17139 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:49.186507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5539314-aafd-4d56-99bd-1289bea17139 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:49.187936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5539314-aafd-4d56-99bd-1289bea17139 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:49.198306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 769/1536] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:45:51.465890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa50758-2530-4e0c-bd05-0d4497fea043 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:51.466480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa50758-2530-4e0c-bd05-0d4497fea043 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:51.466480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa50758-2530-4e0c-bd05-0d4497fea043 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:51.467886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 12:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:45:51.473794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc731143-bf21-407d-ae57-af9a0f229445 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:51.474233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc731143-bf21-407d-ae57-af9a0f229445 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:51.474329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc731143-bf21-407d-ae57-af9a0f229445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:51.492402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-dc731143-bf21-407d-ae57-af9a0f229445 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:45:51.493588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-dc731143-bf21-407d-ae57-af9a0f229445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:51.501971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 12:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:45:51.773866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa50758-2530-4e0c-bd05-0d4497fea043 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:45:51.775579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-efa50758-2530-4e0c-bd05-0d4497fea043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:45:51.790253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa50758-2530-4e0c-bd05-0d4497fea043 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:45:51.793973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12f89c-9256-41f3-ac19-d90a2459824a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:45:51.794683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f89c-9256-41f3-ac19-d90a2459824a service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:45:51.794968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f89c-9256-41f3-ac19-d90a2459824a service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:45:51.795245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12f89c-9256-41f3-ac19-d90a2459824a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:45:51.805472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12f89c-9256-41f3-ac19-d90a2459824a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:45:51.806977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12f89c-9256-41f3-ac19-d90a2459824a service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:45:51.818083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 769/1539] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:46:01.487220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=32 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:46:01.812931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=33 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:28.034641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbaa6-a6b7-48cd-8146-44420f0b293c None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.043215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbaa6-a6b7-48cd-8146-44420f0b293c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.043215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dfbaa6-a6b7-48cd-8146-44420f0b293c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.089310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-c6dfbaa6-a6b7-48cd-8146-44420f0b293c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.093978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c6dfbaa6-a6b7-48cd-8146-44420f0b293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.107835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 771/1540] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.121874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95915dd2-ad0c-4822-932f-240d4789eb70 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.122861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95915dd2-ad0c-4822-932f-240d4789eb70 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.122861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95915dd2-ad0c-4822-932f-240d4789eb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.152488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-95915dd2-ad0c-4822-932f-240d4789eb70 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.155340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-95915dd2-ad0c-4822-932f-240d4789eb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.171534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 770/1541] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.177077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfbaa6-a6b7-48cd-8146-44420f0b293c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.192906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dfbaa6-a6b7-48cd-8146-44420f0b293c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.197893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.203306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.203306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.203306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.203306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:28.203306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.203306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.218067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30126-6f1e-4fde-a950-06358ea7c708 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.218434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30126-6f1e-4fde-a950-06358ea7c708 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.218850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d30126-6f1e-4fde-a950-06358ea7c708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.233952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 772/1542] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:28.253250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.255728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-38d30126-6f1e-4fde-a950-06358ea7c708 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.256965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-38d30126-6f1e-4fde-a950-06358ea7c708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.270658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 771/1543] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:28.273708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610d9a3-ad66-4e12-a192-f326f003baf5 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.287039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab601e-e107-4043-b684-53dad0c86aad None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.287039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab601e-e107-4043-b684-53dad0c86aad None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.287280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab601e-e107-4043-b684-53dad0c86aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.291487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14db5b7-14b2-4efc-919f-911ae3283f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.292501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db5b7-14b2-4efc-919f-911ae3283f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.293314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db5b7-14b2-4efc-919f-911ae3283f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.293748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14db5b7-14b2-4efc-919f-911ae3283f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.294923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14db5b7-14b2-4efc-919f-911ae3283f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.303963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING py.warnings [None req-d14db5b7-14b2-4efc-919f-911ae3283f4c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:47:28.303963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: warnings.warn(msg) May 26 12:47:28.303963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: May 26 12:47:28.305345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14db5b7-14b2-4efc-919f-911ae3283f4c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.318579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4cab601e-e107-4043-b684-53dad0c86aad None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.318579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4cab601e-e107-4043-b684-53dad0c86aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.327019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 772/1544] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.331300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911992d2-58ef-4d9a-8cff-cda2683e2777 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.331300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911992d2-58ef-4d9a-8cff-cda2683e2777 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.331300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911992d2-58ef-4d9a-8cff-cda2683e2777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.350875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-911992d2-58ef-4d9a-8cff-cda2683e2777 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.352155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-911992d2-58ef-4d9a-8cff-cda2683e2777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.366838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 773/1545] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.369832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911992d2-58ef-4d9a-8cff-cda2683e2777 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.385927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911992d2-58ef-4d9a-8cff-cda2683e2777 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.391225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d9258-e0cf-4c5e-b5ec-3c11d0abafaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.391920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d9258-e0cf-4c5e-b5ec-3c11d0abafaa admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.392206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d9258-e0cf-4c5e-b5ec-3c11d0abafaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.392533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d9258-e0cf-4c5e-b5ec-3c11d0abafaa admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.393280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d9258-e0cf-4c5e-b5ec-3c11d0abafaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:28.393594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d9258-e0cf-4c5e-b5ec-3c11d0abafaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.394919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-0b1d9258-e0cf-4c5e-b5ec-3c11d0abafaa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 12:47:28.394919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 26 12:47:28.394919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: May 26 12:47:28.395907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d9258-e0cf-4c5e-b5ec-3c11d0abafaa admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.410611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 774/1546] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:28.411974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b5938-9aee-40e1-b781-ed6a4e098b71 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.412903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b5938-9aee-40e1-b781-ed6a4e098b71 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.412903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b5938-9aee-40e1-b781-ed6a4e098b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.437554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-149b5938-9aee-40e1-b781-ed6a4e098b71 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.438963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-149b5938-9aee-40e1-b781-ed6a4e098b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.452509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 775/1547] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.452509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a320-d317-4944-867c-7e38c2f33f73 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.452509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a320-d317-4944-867c-7e38c2f33f73 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.452509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7501a320-d317-4944-867c-7e38c2f33f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.470947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 773/1548] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/projects => generated 387 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:28.473384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c4eac-e000-49f1-9550-625ab37071fb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.473894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c4eac-e000-49f1-9550-625ab37071fb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.474374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c4eac-e000-49f1-9550-625ab37071fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.479583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7501a320-d317-4944-867c-7e38c2f33f73 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.486148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7501a320-d317-4944-867c-7e38c2f33f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.498846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f76c4eac-e000-49f1-9550-625ab37071fb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.500061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f76c4eac-e000-49f1-9550-625ab37071fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.556772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 776/1549] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.557591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501a320-d317-4944-867c-7e38c2f33f73 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.567541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7501a320-d317-4944-867c-7e38c2f33f73 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.571866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 774/1550] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.572304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486a7f9-7ab7-4824-be5c-eefc20973e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.573043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a7f9-7ab7-4824-be5c-eefc20973e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.573328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a7f9-7ab7-4824-be5c-eefc20973e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.573604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486a7f9-7ab7-4824-be5c-eefc20973e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.574401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486a7f9-7ab7-4824-be5c-eefc20973e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.576330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486a7f9-7ab7-4824-be5c-eefc20973e05 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.576579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43faa52-6d7f-44f3-bd79-7200634ba2af None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.576867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43faa52-6d7f-44f3-bd79-7200634ba2af None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.577141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43faa52-6d7f-44f3-bd79-7200634ba2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.595925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-a43faa52-6d7f-44f3-bd79-7200634ba2af None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.597191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a43faa52-6d7f-44f3-bd79-7200634ba2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.608687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 775/1551] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.610025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd09dc-cc18-4743-8bbe-314d60f42721 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.610328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd09dc-cc18-4743-8bbe-314d60f42721 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.610658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd09dc-cc18-4743-8bbe-314d60f42721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.629973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4bcd09dc-cc18-4743-8bbe-314d60f42721 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.631213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4bcd09dc-cc18-4743-8bbe-314d60f42721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.639246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 776/1552] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.643109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd211-6112-481e-bc05-25d2fd29bb6e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.643109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd211-6112-481e-bc05-25d2fd29bb6e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.643109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd211-6112-481e-bc05-25d2fd29bb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.663046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-8b0cd211-6112-481e-bc05-25d2fd29bb6e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.664233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8b0cd211-6112-481e-bc05-25d2fd29bb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.672334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 777/1553] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.677813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50d8a-2a5d-40aa-8148-29760f79da36 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.677813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50d8a-2a5d-40aa-8148-29760f79da36 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.677813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50d8a-2a5d-40aa-8148-29760f79da36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.678108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 777/1554] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:28.678108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486a7f9-7ab7-4824-be5c-eefc20973e05 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.697954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-51b50d8a-2a5d-40aa-8148-29760f79da36 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.699495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-51b50d8a-2a5d-40aa-8148-29760f79da36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.747861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486a7f9-7ab7-4824-be5c-eefc20973e05 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.753844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98015dc7-7356-4bf5-9f4e-21d4a5922417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.755146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015dc7-7356-4bf5-9f4e-21d4a5922417 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.755565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015dc7-7356-4bf5-9f4e-21d4a5922417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.755850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015dc7-7356-4bf5-9f4e-21d4a5922417 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.756556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98015dc7-7356-4bf5-9f4e-21d4a5922417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.757585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-98015dc7-7356-4bf5-9f4e-21d4a5922417 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:47:28.757585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 26 12:47:28.757585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: May 26 12:47:28.758838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98015dc7-7356-4bf5-9f4e-21d4a5922417 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.761824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 778/1555] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.763197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f1d6-b8b3-4970-8862-438a78598527 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.763515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f1d6-b8b3-4970-8862-438a78598527 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.763812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f1d6-b8b3-4970-8862-438a78598527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.783568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7d24f1d6-b8b3-4970-8862-438a78598527 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.785670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7d24f1d6-b8b3-4970-8862-438a78598527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.793966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 779/1556] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.794889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24f1d6-b8b3-4970-8862-438a78598527 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.805063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24f1d6-b8b3-4970-8862-438a78598527 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.809750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e17f2-9405-407f-9561-4ecab0773f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.810345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e17f2-9405-407f-9561-4ecab0773f3b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.810655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e17f2-9405-407f-9561-4ecab0773f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.810925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e17f2-9405-407f-9561-4ecab0773f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.811644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e17f2-9405-407f-9561-4ecab0773f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:28.811947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e17f2-9405-407f-9561-4ecab0773f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.813772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e17f2-9405-407f-9561-4ecab0773f3b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.825936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 780/1557] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:28.827302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4440-ae6f-408d-9941-1fbfedf6f251 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.827583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4440-ae6f-408d-9941-1fbfedf6f251 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.827848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb4440-ae6f-408d-9941-1fbfedf6f251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.846559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-3deb4440-ae6f-408d-9941-1fbfedf6f251 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.848466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3deb4440-ae6f-408d-9941-1fbfedf6f251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.852997 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 778/1558] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:28.854149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16403-74b1-42a6-bb3e-a1869790b57b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.854437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16403-74b1-42a6-bb3e-a1869790b57b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.854736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a16403-74b1-42a6-bb3e-a1869790b57b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.861256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 781/1559] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.861256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb4440-ae6f-408d-9941-1fbfedf6f251 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.870126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb4440-ae6f-408d-9941-1fbfedf6f251 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.874779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1c9d6-6aa2-4480-8c61-8a4436e3d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.875459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1c9d6-6aa2-4480-8c61-8a4436e3d581 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.875742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1c9d6-6aa2-4480-8c61-8a4436e3d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.876015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1c9d6-6aa2-4480-8c61-8a4436e3d581 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.876716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1c9d6-6aa2-4480-8c61-8a4436e3d581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.878658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1c9d6-6aa2-4480-8c61-8a4436e3d581 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.882353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-01a16403-74b1-42a6-bb3e-a1869790b57b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.883660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-01a16403-74b1-42a6-bb3e-a1869790b57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.889506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:28.892833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 779/1560] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.894193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2cad1-76e4-4345-bd52-da2b84401c52 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.895158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2cad1-76e4-4345-bd52-da2b84401c52 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.895643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2cad1-76e4-4345-bd52-da2b84401c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.914747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b6b2cad1-76e4-4345-bd52-da2b84401c52 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:28.915954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b6b2cad1-76e4-4345-bd52-da2b84401c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:28.924029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 780/1561] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:28.924815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2cad1-76e4-4345-bd52-da2b84401c52 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.934824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2cad1-76e4-4345-bd52-da2b84401c52 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.939345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.940007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.940288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.940556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.941862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:28.942163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.943790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.951309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:28.956630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 781/1562] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:28.958053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.967988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23e6e49-8fa8-483b-80be-836726bd8d33 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:28.972572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:28.973269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:28.973624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:28.973902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:28.974658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:28.974964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:28.976612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:28.990246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 782/1563] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:28.991256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:28.995051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 782/1564] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:28.997838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1c9d6-6aa2-4480-8c61-8a4436e3d581 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.003556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c614d-558f-4c1d-8efd-a62dbcb0e037 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.010606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c27d-811b-49cc-96f6-d3cd9ee4df1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.010959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1c9d6-6aa2-4480-8c61-8a4436e3d581 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.011288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c27d-811b-49cc-96f6-d3cd9ee4df1a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.011564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c27d-811b-49cc-96f6-d3cd9ee4df1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.011885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c27d-811b-49cc-96f6-d3cd9ee4df1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.012545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c27d-811b-49cc-96f6-d3cd9ee4df1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.014461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c27d-811b-49cc-96f6-d3cd9ee4df1a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.023406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8bef2-18a5-47f5-95e1-eabb59e6a932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.024141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8bef2-18a5-47f5-95e1-eabb59e6a932 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.024424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8bef2-18a5-47f5-95e1-eabb59e6a932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.024860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab8bef2-18a5-47f5-95e1-eabb59e6a932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.025593 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8bef2-18a5-47f5-95e1-eabb59e6a932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.027223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab8bef2-18a5-47f5-95e1-eabb59e6a932 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.039222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 783/1565] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:29.040090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8bef2-18a5-47f5-95e1-eabb59e6a932 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.052214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab8bef2-18a5-47f5-95e1-eabb59e6a932 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.059405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.060453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.060864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.061325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.062502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:29.063020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.064922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.078546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 784/1566] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:29.079391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.089949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23d518-d99a-4337-846d-f591d93e6f4f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.094548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.095219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.095501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.095779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.096504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:29.096808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.098462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.110474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 785/1567] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:29.111372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.122415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c3d73-9f10-47a4-9728-90a8c698dc1f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.127299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 783/1568] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:28 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:29.127299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c27d-811b-49cc-96f6-d3cd9ee4df1a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.193019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c27d-811b-49cc-96f6-d3cd9ee4df1a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.194261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.195353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.195795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.196253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.197473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:29.197970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.198990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f4a83-1ed1-4ff8-bd30-c97fabbd543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.199947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4a83-1ed1-4ff8-bd30-c97fabbd543d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.200600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4a83-1ed1-4ff8-bd30-c97fabbd543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.200735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.200849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f4a83-1ed1-4ff8-bd30-c97fabbd543d admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.201568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f4a83-1ed1-4ff8-bd30-c97fabbd543d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.203851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174f4a83-1ed1-4ff8-bd30-c97fabbd543d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.214049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 786/1569] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:29.214976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.227395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd970e50-d701-41cb-a09d-4594b6fcf90d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.232142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b5160-39d3-4c2f-a7c2-1d69575b5ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.292646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5160-39d3-4c2f-a7c2-1d69575b5ede admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.292646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5160-39d3-4c2f-a7c2-1d69575b5ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.292646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5160-39d3-4c2f-a7c2-1d69575b5ede admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.292646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b5160-39d3-4c2f-a7c2-1d69575b5ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.292646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b5160-39d3-4c2f-a7c2-1d69575b5ede admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.421279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 784/1570] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/projects => generated 365 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:29.421494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 787/1571] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/projects => generated 385 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:29.421596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f4a83-1ed1-4ff8-bd30-c97fabbd543d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.421716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b5160-39d3-4c2f-a7c2-1d69575b5ede admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.492185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b5160-39d3-4c2f-a7c2-1d69575b5ede admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.505642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174f4a83-1ed1-4ff8-bd30-c97fabbd543d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.510510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aae01-95c1-477e-8443-4070c6ea2d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.511224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aae01-95c1-477e-8443-4070c6ea2d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.511506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aae01-95c1-477e-8443-4070c6ea2d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.511782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30aae01-95c1-477e-8443-4070c6ea2d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.512515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aae01-95c1-477e-8443-4070c6ea2d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.514125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30aae01-95c1-477e-8443-4070c6ea2d01 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.524655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 785/1572] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:29.525486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aae01-95c1-477e-8443-4070c6ea2d01 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.533623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:29.537758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30aae01-95c1-477e-8443-4070c6ea2d01 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.545005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e161c-7ab9-4251-a61e-ba8d9e320e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.552152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e161c-7ab9-4251-a61e-ba8d9e320e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.552152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e161c-7ab9-4251-a61e-ba8d9e320e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.552152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e161c-7ab9-4251-a61e-ba8d9e320e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.552152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e161c-7ab9-4251-a61e-ba8d9e320e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.552152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e161c-7ab9-4251-a61e-ba8d9e320e6f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.559418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09ba72-bd0e-464e-a267-9dc7d8a2db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.560106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09ba72-bd0e-464e-a267-9dc7d8a2db87 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.560388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09ba72-bd0e-464e-a267-9dc7d8a2db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.560667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09ba72-bd0e-464e-a267-9dc7d8a2db87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.561396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09ba72-bd0e-464e-a267-9dc7d8a2db87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.563102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09ba72-bd0e-464e-a267-9dc7d8a2db87 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.573931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 788/1573] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:29.575433 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09ba72-bd0e-464e-a267-9dc7d8a2db87 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.586407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09ba72-bd0e-464e-a267-9dc7d8a2db87 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.596531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7546db-a5c4-4dda-ae39-1abd242f6436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.597225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7546db-a5c4-4dda-ae39-1abd242f6436 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.597505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7546db-a5c4-4dda-ae39-1abd242f6436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.597779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7546db-a5c4-4dda-ae39-1abd242f6436 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.598477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7546db-a5c4-4dda-ae39-1abd242f6436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.600506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7546db-a5c4-4dda-ae39-1abd242f6436 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.665532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 786/1574] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:29.666321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e161c-7ab9-4251-a61e-ba8d9e320e6f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.688654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:29.697708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 789/1575] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:29.697708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7546db-a5c4-4dda-ae39-1abd242f6436 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.739514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e161c-7ab9-4251-a61e-ba8d9e320e6f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.771232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7546db-a5c4-4dda-ae39-1abd242f6436 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.776069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4dea3-1802-45d0-b1d0-8feeba314fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.777594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4dea3-1802-45d0-b1d0-8feeba314fca admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.777594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4dea3-1802-45d0-b1d0-8feeba314fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.777594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4dea3-1802-45d0-b1d0-8feeba314fca admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.778063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4dea3-1802-45d0-b1d0-8feeba314fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.780076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4dea3-1802-45d0-b1d0-8feeba314fca admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.803142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b84c9-91bf-4cf1-acdf-c7f0a8cabb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.803825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b84c9-91bf-4cf1-acdf-c7f0a8cabb5d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.804109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b84c9-91bf-4cf1-acdf-c7f0a8cabb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.804386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b84c9-91bf-4cf1-acdf-c7f0a8cabb5d admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.805081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b84c9-91bf-4cf1-acdf-c7f0a8cabb5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.807034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b84c9-91bf-4cf1-acdf-c7f0a8cabb5d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:29.893160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 790/1576] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:29.894935 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4dea3-1802-45d0-b1d0-8feeba314fca admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.925142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 787/1577] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/users => generated 296 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:29.926893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b84c9-91bf-4cf1-acdf-c7f0a8cabb5d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:29.938254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b84c9-91bf-4cf1-acdf-c7f0a8cabb5d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.969174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4dea3-1802-45d0-b1d0-8feeba314fca admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:29.975455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e922e-d653-41ee-b77a-1aaf67be3aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:29.976147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e922e-d653-41ee-b77a-1aaf67be3aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:29.976420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e922e-d653-41ee-b77a-1aaf67be3aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:29.976691 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e922e-d653-41ee-b77a-1aaf67be3aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:29.977387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e922e-d653-41ee-b77a-1aaf67be3aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:29.979484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e922e-d653-41ee-b77a-1aaf67be3aa8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.009243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d395-016a-4bfd-9e86-eb16ea451dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.009939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d395-016a-4bfd-9e86-eb16ea451dae admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.010222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d395-016a-4bfd-9e86-eb16ea451dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.010500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab8d395-016a-4bfd-9e86-eb16ea451dae admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.011233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d395-016a-4bfd-9e86-eb16ea451dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.013171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab8d395-016a-4bfd-9e86-eb16ea451dae admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.114951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 791/1578] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:30.115952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e922e-d653-41ee-b77a-1aaf67be3aa8 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.129832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e922e-d653-41ee-b77a-1aaf67be3aa8 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.134332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b6b38-6450-4c47-8ca7-8b994667bed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.135040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6b38-6450-4c47-8ca7-8b994667bed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.135314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6b38-6450-4c47-8ca7-8b994667bed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.135583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b6b38-6450-4c47-8ca7-8b994667bed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.136296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b6b38-6450-4c47-8ca7-8b994667bed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.137880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b6b38-6450-4c47-8ca7-8b994667bed6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.152785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 792/1579] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.152785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b6b38-6450-4c47-8ca7-8b994667bed6 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.157975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 788/1580] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:29 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:30.157975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d395-016a-4bfd-9e86-eb16ea451dae admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.164017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b6b38-6450-4c47-8ca7-8b994667bed6 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.168799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.169067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab8d395-016a-4bfd-9e86-eb16ea451dae admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.169723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.169999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.170269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] PATH_INFO: `/v3/projects/7305192f53864869903074b061fc0e40/users/a3b882edba144c64be08837223910f28/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.173763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df9804-35ac-484a-b369-73ca0ae33ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.174545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9804-35ac-484a-b369-73ca0ae33ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.174831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9804-35ac-484a-b369-73ca0ae33ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.175105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df9804-35ac-484a-b369-73ca0ae33ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.175858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df9804-35ac-484a-b369-73ca0ae33ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.178408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df9804-35ac-484a-b369-73ca0ae33ff3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.183468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:30.186534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7305192f53864869903074b061fc0e40, user_id=a3b882edba144c64be08837223910f28, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.187645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING py.warnings [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:47:30.187645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: warnings.warn(msg) May 26 12:47:30.187645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: May 26 12:47:30.189541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.309132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 789/1581] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:30 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:30.310082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df9804-35ac-484a-b369-73ca0ae33ff3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.322399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df9804-35ac-484a-b369-73ca0ae33ff3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.327590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 793/1582] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:30 2022] PUT /identity/v3/projects/7305192f53864869903074b061fc0e40/users/a3b882edba144c64be08837223910f28/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:30.338757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.352339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:30.389496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc7c9-298d-4674-9e97-d575f0156b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.390191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc7c9-298d-4674-9e97-d575f0156b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.390474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc7c9-298d-4674-9e97-d575f0156b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.390784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dc7c9-298d-4674-9e97-d575f0156b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.391479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dc7c9-298d-4674-9e97-d575f0156b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.393414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dc7c9-298d-4674-9e97-d575f0156b7d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.419742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33475f50-85a1-48c3-9052-8782aef97718 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.424316 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66836d70-0c92-449f-a44e-2d9b7fd30d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.424992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66836d70-0c92-449f-a44e-2d9b7fd30d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.425273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66836d70-0c92-449f-a44e-2d9b7fd30d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.425540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66836d70-0c92-449f-a44e-2d9b7fd30d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.427621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66836d70-0c92-449f-a44e-2d9b7fd30d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.429531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66836d70-0c92-449f-a44e-2d9b7fd30d6a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.543805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 790/1583] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:30 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:30.544671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc7c9-298d-4674-9e97-d575f0156b7d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.555856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dc7c9-298d-4674-9e97-d575f0156b7d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.558270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 794/1584] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:30 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:30.558270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66836d70-0c92-449f-a44e-2d9b7fd30d6a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.564596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2e727-809f-4e1a-8ed3-7add6fb72c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.564596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e727-809f-4e1a-8ed3-7add6fb72c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.564596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e727-809f-4e1a-8ed3-7add6fb72c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.564596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2e727-809f-4e1a-8ed3-7add6fb72c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.565222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2e727-809f-4e1a-8ed3-7add6fb72c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.565222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd2e727-809f-4e1a-8ed3-7add6fb72c3d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.568146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66836d70-0c92-449f-a44e-2d9b7fd30d6a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.572973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab891-fd8d-4fcf-934d-e6a7219c17de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.573640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab891-fd8d-4fcf-934d-e6a7219c17de admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.573915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab891-fd8d-4fcf-934d-e6a7219c17de admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.574291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27ab891-fd8d-4fcf-934d-e6a7219c17de admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.575064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab891-fd8d-4fcf-934d-e6a7219c17de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.575443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 791/1585] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.576283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2e727-809f-4e1a-8ed3-7add6fb72c3d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.576664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27ab891-fd8d-4fcf-934d-e6a7219c17de admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.587767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 795/1586] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.588628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab891-fd8d-4fcf-934d-e6a7219c17de admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.590258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2e727-809f-4e1a-8ed3-7add6fb72c3d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.596971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eda9a-459e-45f2-9a83-5c6c24ae2b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.598515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eda9a-459e-45f2-9a83-5c6c24ae2b4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.598836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eda9a-459e-45f2-9a83-5c6c24ae2b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.599146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53eda9a-459e-45f2-9a83-5c6c24ae2b4c admin admin] PATH_INFO: `/v3/projects/87a842d33e6043a99b1cfa595a06c723/users/3a709d15f5534cf398c2ead09627b09c/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.599623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27ab891-fd8d-4fcf-934d-e6a7219c17de admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.604420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf3f6-5456-42c8-bee2-0599bdca9cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.605105 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf3f6-5456-42c8-bee2-0599bdca9cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.605380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf3f6-5456-42c8-bee2-0599bdca9cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.605646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74edf3f6-5456-42c8-bee2-0599bdca9cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.606359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf3f6-5456-42c8-bee2-0599bdca9cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.608008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74edf3f6-5456-42c8-bee2-0599bdca9cf6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.620280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53eda9a-459e-45f2-9a83-5c6c24ae2b4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87a842d33e6043a99b1cfa595a06c723, user_id=3a709d15f5534cf398c2ead09627b09c, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.620606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 796/1587] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.621359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf3f6-5456-42c8-bee2-0599bdca9cf6 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.623004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53eda9a-459e-45f2-9a83-5c6c24ae2b4c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.635496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74edf3f6-5456-42c8-bee2-0599bdca9cf6 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.642846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20681cc-fb2b-4df3-9183-4e9b156cfca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.642846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20681cc-fb2b-4df3-9183-4e9b156cfca5 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.642846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20681cc-fb2b-4df3-9183-4e9b156cfca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.642846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20681cc-fb2b-4df3-9183-4e9b156cfca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.643204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20681cc-fb2b-4df3-9183-4e9b156cfca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.644089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20681cc-fb2b-4df3-9183-4e9b156cfca5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.655221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 797/1588] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.656743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3701-caf4-4b61-b712-97f69629e94d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.657034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3701-caf4-4b61-b712-97f69629e94d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.657526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf3701-caf4-4b61-b712-97f69629e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.685602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-cfaf3701-caf4-4b61-b712-97f69629e94d None None] MFA Rules not processed for user `a3b882edba144c64be08837223910f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:30.686684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cfaf3701-caf4-4b61-b712-97f69629e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:30.709556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 792/1589] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:30 2022] PUT /identity/v3/projects/87a842d33e6043a99b1cfa595a06c723/users/3a709d15f5534cf398c2ead09627b09c/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:30.710173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eda9a-459e-45f2-9a83-5c6c24ae2b4c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.757145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 798/1590] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:30.758100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf3701-caf4-4b61-b712-97f69629e94d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.769129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf3701-caf4-4b61-b712-97f69629e94d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.786065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53eda9a-459e-45f2-9a83-5c6c24ae2b4c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.794373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336448be-d640-49c5-a9da-bac46bcd21c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.795106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336448be-d640-49c5-a9da-bac46bcd21c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.795387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336448be-d640-49c5-a9da-bac46bcd21c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.795660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336448be-d640-49c5-a9da-bac46bcd21c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.796390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336448be-d640-49c5-a9da-bac46bcd21c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.797996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336448be-d640-49c5-a9da-bac46bcd21c0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.808965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 793/1591] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.809815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336448be-d640-49c5-a9da-bac46bcd21c0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.812674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:30.820658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336448be-d640-49c5-a9da-bac46bcd21c0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.826208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722c318-2c85-4665-959c-62ba175f6e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.826424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722c318-2c85-4665-959c-62ba175f6e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.826741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722c318-2c85-4665-959c-62ba175f6e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.827018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722c318-2c85-4665-959c-62ba175f6e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.827796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722c318-2c85-4665-959c-62ba175f6e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.829341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722c318-2c85-4665-959c-62ba175f6e40 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.841148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 794/1592] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.841982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722c318-2c85-4665-959c-62ba175f6e40 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.842143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320ea97-a0ac-46a6-836e-f1b0136b17ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.842710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ea97-a0ac-46a6-836e-f1b0136b17ae admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.842988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ea97-a0ac-46a6-836e-f1b0136b17ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.843260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320ea97-a0ac-46a6-836e-f1b0136b17ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.843982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320ea97-a0ac-46a6-836e-f1b0136b17ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.845964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320ea97-a0ac-46a6-836e-f1b0136b17ae admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.854831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722c318-2c85-4665-959c-62ba175f6e40 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.857358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 799/1593] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.858268 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320ea97-a0ac-46a6-836e-f1b0136b17ae admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.862377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62dd29-f4fd-4b77-9fd1-60922fb88e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.863130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62dd29-f4fd-4b77-9fd1-60922fb88e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.863692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62dd29-f4fd-4b77-9fd1-60922fb88e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.864229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62dd29-f4fd-4b77-9fd1-60922fb88e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.865062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62dd29-f4fd-4b77-9fd1-60922fb88e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.867050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62dd29-f4fd-4b77-9fd1-60922fb88e2f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.868857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320ea97-a0ac-46a6-836e-f1b0136b17ae admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.873680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43828ad-50e6-42cf-916a-a1e3915fb40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.874553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43828ad-50e6-42cf-916a-a1e3915fb40e admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.877548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43828ad-50e6-42cf-916a-a1e3915fb40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.877548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43828ad-50e6-42cf-916a-a1e3915fb40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.877548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43828ad-50e6-42cf-916a-a1e3915fb40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.877548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43828ad-50e6-42cf-916a-a1e3915fb40e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.878320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 795/1594] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.879261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62dd29-f4fd-4b77-9fd1-60922fb88e2f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.888540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 800/1595] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.889921 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299994-2e47-4cc1-a90a-7e94ba37d3f9 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.890210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299994-2e47-4cc1-a90a-7e94ba37d3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.890482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6299994-2e47-4cc1-a90a-7e94ba37d3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.892846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62dd29-f4fd-4b77-9fd1-60922fb88e2f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.900285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a5054-76b3-4233-b9e8-c076fb001e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.901285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a5054-76b3-4233-b9e8-c076fb001e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.901890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a5054-76b3-4233-b9e8-c076fb001e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.902362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a5054-76b3-4233-b9e8-c076fb001e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.904065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a5054-76b3-4233-b9e8-c076fb001e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.906476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a5054-76b3-4233-b9e8-c076fb001e0b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.918540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 796/1596] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:30.919777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a5054-76b3-4233-b9e8-c076fb001e0b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:30.920561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f6299994-2e47-4cc1-a90a-7e94ba37d3f9 None None] MFA Rules not processed for user `3a709d15f5534cf398c2ead09627b09c`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:30.921963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f6299994-2e47-4cc1-a90a-7e94ba37d3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:30.931042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a5054-76b3-4233-b9e8-c076fb001e0b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:30.936237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609ddf-17e2-411b-a967-18924b57d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:30.936845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609ddf-17e2-411b-a967-18924b57d5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:30.937126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609ddf-17e2-411b-a967-18924b57d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:30.937400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5609ddf-17e2-411b-a967-18924b57d5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:30.938094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5609ddf-17e2-411b-a967-18924b57d5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:30.940024 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5609ddf-17e2-411b-a967-18924b57d5f8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:30.990375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 801/1597] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:30.991404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299994-2e47-4cc1-a90a-7e94ba37d3f9 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.003947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6299994-2e47-4cc1-a90a-7e94ba37d3f9 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.011315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0fa3-eb94-4602-8445-72ca9e5dcfce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.012381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0fa3-eb94-4602-8445-72ca9e5dcfce admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.012821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0fa3-eb94-4602-8445-72ca9e5dcfce admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.013265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf0fa3-eb94-4602-8445-72ca9e5dcfce admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.014456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf0fa3-eb94-4602-8445-72ca9e5dcfce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.017185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaf0fa3-eb94-4602-8445-72ca9e5dcfce admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.040272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 802/1598] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:31.040272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0fa3-eb94-4602-8445-72ca9e5dcfce admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.055867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaf0fa3-eb94-4602-8445-72ca9e5dcfce admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.063145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9e871-acd2-4923-999b-1781e6c465f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.064596 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e871-acd2-4923-999b-1781e6c465f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.065067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e871-acd2-4923-999b-1781e6c465f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.065545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9e871-acd2-4923-999b-1781e6c465f2 admin admin] PATH_INFO: `/v3/projects/98c0c747833441bda0a5f8d62de53cd3/users/e24e8e8d0b8042bfb7ee7881aa8a16c1/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.075338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 797/1599] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:30 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:31.089415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609ddf-17e2-411b-a967-18924b57d5f8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.089668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9e871-acd2-4923-999b-1781e6c465f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98c0c747833441bda0a5f8d62de53cd3, user_id=e24e8e8d0b8042bfb7ee7881aa8a16c1, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.089668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9e871-acd2-4923-999b-1781e6c465f2 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.105657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.142172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5609ddf-17e2-411b-a967-18924b57d5f8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.147185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83350234-8eee-4989-b979-b407e80698e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.152678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83350234-8eee-4989-b979-b407e80698e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.152678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83350234-8eee-4989-b979-b407e80698e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.152678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83350234-8eee-4989-b979-b407e80698e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.152678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83350234-8eee-4989-b979-b407e80698e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.152678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83350234-8eee-4989-b979-b407e80698e3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.163214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 798/1600] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:31.164058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83350234-8eee-4989-b979-b407e80698e3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.174839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83350234-8eee-4989-b979-b407e80698e3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.181560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bac5d-6f27-49cd-8539-057c40a72cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.181560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bac5d-6f27-49cd-8539-057c40a72cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.181560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bac5d-6f27-49cd-8539-057c40a72cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.181916 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010bac5d-6f27-49cd-8539-057c40a72cf5 admin admin] PATH_INFO: `/v3/projects/20667d6f11634df7a04808743d9dde8f/users/13e852d405be45b6a4ae2182df0b91a7/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.200773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bac5d-6f27-49cd-8539-057c40a72cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20667d6f11634df7a04808743d9dde8f, user_id=13e852d405be45b6a4ae2182df0b91a7, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.203442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010bac5d-6f27-49cd-8539-057c40a72cf5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.206027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 803/1601] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:31 2022] PUT /identity/v3/projects/98c0c747833441bda0a5f8d62de53cd3/users/e24e8e8d0b8042bfb7ee7881aa8a16c1/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:31.211102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9e871-acd2-4923-999b-1781e6c465f2 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.271894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9e871-acd2-4923-999b-1781e6c465f2 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.276580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45aa0-19e6-4d00-b6cc-79e04d40b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.277484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45aa0-19e6-4d00-b6cc-79e04d40b6c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.277763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45aa0-19e6-4d00-b6cc-79e04d40b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.278039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45aa0-19e6-4d00-b6cc-79e04d40b6c7 admin admin] PATH_INFO: `/v3/projects/9d8acc50df024762ac7fe1ad90a51636/users/16d8d5e517dc49a68661675fd1158ff4/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.295112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa45aa0-19e6-4d00-b6cc-79e04d40b6c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d8acc50df024762ac7fe1ad90a51636, user_id=16d8d5e517dc49a68661675fd1158ff4, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.297780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa45aa0-19e6-4d00-b6cc-79e04d40b6c7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.321386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 799/1602] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:31 2022] PUT /identity/v3/projects/20667d6f11634df7a04808743d9dde8f/users/13e852d405be45b6a4ae2182df0b91a7/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:31.328408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bac5d-6f27-49cd-8539-057c40a72cf5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.378815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.384184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 804/1603] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:31 2022] PUT /identity/v3/projects/9d8acc50df024762ac7fe1ad90a51636/users/16d8d5e517dc49a68661675fd1158ff4/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:31.385517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aaaa4-736e-4747-9c4e-2c48068dc15e None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.385795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aaaa4-736e-4747-9c4e-2c48068dc15e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.386065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aaaa4-736e-4747-9c4e-2c48068dc15e None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.387626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 805/1604] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 26 12:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:47:31.388235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aaaa4-736e-4747-9c4e-2c48068dc15e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.398209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010bac5d-6f27-49cd-8539-057c40a72cf5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.455673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6390a-8b85-4211-b78c-7bbe721332ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.456477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6390a-8b85-4211-b78c-7bbe721332ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.456752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6390a-8b85-4211-b78c-7bbe721332ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.457059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6390a-8b85-4211-b78c-7bbe721332ba admin admin] PATH_INFO: `/v3/projects/cffce3a08ba34b79aadf8d0399aff80f/users/98a275f65a3544a5b073fbf1ee10034b/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.464673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aaaa4-736e-4747-9c4e-2c48068dc15e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.469438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873c0d2-0a0b-4963-928d-d6700486b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.470334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873c0d2-0a0b-4963-928d-d6700486b117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.470643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873c0d2-0a0b-4963-928d-d6700486b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.470915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873c0d2-0a0b-4963-928d-d6700486b117 admin admin] PATH_INFO: `/v3/projects/20b96e086a2544f6863deb39403e425c/users/6b148a9fa622488197fc684ccb665e1b/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.474332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6390a-8b85-4211-b78c-7bbe721332ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=cffce3a08ba34b79aadf8d0399aff80f, user_id=98a275f65a3544a5b073fbf1ee10034b, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.478209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6390a-8b85-4211-b78c-7bbe721332ba admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.490547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873c0d2-0a0b-4963-928d-d6700486b117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b96e086a2544f6863deb39403e425c, user_id=6b148a9fa622488197fc684ccb665e1b, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.498383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873c0d2-0a0b-4963-928d-d6700486b117 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.590321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 800/1605] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:31 2022] PUT /identity/v3/projects/cffce3a08ba34b79aadf8d0399aff80f/users/98a275f65a3544a5b073fbf1ee10034b/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:31.591470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6390a-8b85-4211-b78c-7bbe721332ba admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.619118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 806/1606] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:31 2022] PUT /identity/v3/projects/20b96e086a2544f6863deb39403e425c/users/6b148a9fa622488197fc684ccb665e1b/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:31.620057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873c0d2-0a0b-4963-928d-d6700486b117 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:31.624956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.658986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6390a-8b85-4211-b78c-7bbe721332ba admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.690779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873c0d2-0a0b-4963-928d-d6700486b117 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:31.696415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43453ff-a961-4e3d-9fdd-1675444ac693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.697366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43453ff-a961-4e3d-9fdd-1675444ac693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.697640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43453ff-a961-4e3d-9fdd-1675444ac693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.697912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43453ff-a961-4e3d-9fdd-1675444ac693 admin admin] PATH_INFO: `/v3/projects/f5bba01dc02d413389109b932148e716/users/2bfba39fa804430d83ff85f84dddf70d/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.718007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43453ff-a961-4e3d-9fdd-1675444ac693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5bba01dc02d413389109b932148e716, user_id=2bfba39fa804430d83ff85f84dddf70d, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.720827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43453ff-a961-4e3d-9fdd-1675444ac693 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.827769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 807/1607] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:31 2022] PUT /identity/v3/projects/f5bba01dc02d413389109b932148e716/users/2bfba39fa804430d83ff85f84dddf70d/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:31.829156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b89ce-0702-420e-b206-3f70d09c373f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.829451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b89ce-0702-420e-b206-3f70d09c373f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.829720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b89ce-0702-420e-b206-3f70d09c373f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.851541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-543b89ce-0702-420e-b206-3f70d09c373f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:31.852790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-543b89ce-0702-420e-b206-3f70d09c373f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:31.854880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cdf15b-31d7-42d1-8f11-b808553adeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:31.855579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf15b-31d7-42d1-8f11-b808553adeee admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.856043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf15b-31d7-42d1-8f11-b808553adeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.856422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cdf15b-31d7-42d1-8f11-b808553adeee admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.857159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdf15b-31d7-42d1-8f11-b808553adeee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:31.859164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cdf15b-31d7-42d1-8f11-b808553adeee admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:31.917487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 808/1608] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:31.918947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda56b-8ddf-427a-8f78-5cd03d6e2674 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.919236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda56b-8ddf-427a-8f78-5cd03d6e2674 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.919511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fda56b-8ddf-427a-8f78-5cd03d6e2674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:31.935515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:31.952467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-54fda56b-8ddf-427a-8f78-5cd03d6e2674 None None] MFA Rules not processed for user `13e852d405be45b6a4ae2182df0b91a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:31.953669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-54fda56b-8ddf-427a-8f78-5cd03d6e2674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:31.984212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 801/1609] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:31 2022] POST /identity/v3/users => generated 294 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:31.985491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b924b-ba7e-482e-a358-e1593ff348b2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:31.985776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b924b-ba7e-482e-a358-e1593ff348b2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:31.986051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b924b-ba7e-482e-a358-e1593ff348b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.006168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-666b924b-ba7e-482e-a358-e1593ff348b2 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:32.007503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-666b924b-ba7e-482e-a358-e1593ff348b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:32.025574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 809/1610] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:32.026903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f58a5-0ae9-4fff-8c69-4befb66e0d88 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.027186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f58a5-0ae9-4fff-8c69-4befb66e0d88 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.027457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f58a5-0ae9-4fff-8c69-4befb66e0d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.056654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-fe3f58a5-0ae9-4fff-8c69-4befb66e0d88 None None] MFA Rules not processed for user `16d8d5e517dc49a68661675fd1158ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:32.057857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fe3f58a5-0ae9-4fff-8c69-4befb66e0d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:32.096863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 802/1611] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 26 12:47:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:32.098014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171be736-fffb-497a-8b18-706069f3ce89 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.098262 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171be736-fffb-497a-8b18-706069f3ce89 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.098689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171be736-fffb-497a-8b18-706069f3ce89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.118233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-171be736-fffb-497a-8b18-706069f3ce89 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:32.118233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-171be736-fffb-497a-8b18-706069f3ce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:32.126126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 803/1612] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:32.127602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3ce2-2409-4778-b53c-0bc07d9671e8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.127980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3ce2-2409-4778-b53c-0bc07d9671e8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.128350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc3ce2-2409-4778-b53c-0bc07d9671e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.136040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 810/1613] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:32.139749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a3c7-7aae-4910-9619-75eb61d344a7 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.139749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a3c7-7aae-4910-9619-75eb61d344a7 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.139749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986a3c7-7aae-4910-9619-75eb61d344a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.156794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-16dc3ce2-2409-4778-b53c-0bc07d9671e8 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:32.158027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-16dc3ce2-2409-4778-b53c-0bc07d9671e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:32.169259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 804/1614] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:32.169932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc3ce2-2409-4778-b53c-0bc07d9671e8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.178110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b986a3c7-7aae-4910-9619-75eb61d344a7 None None] MFA Rules not processed for user `2bfba39fa804430d83ff85f84dddf70d`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:32.180442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b986a3c7-7aae-4910-9619-75eb61d344a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:32.229409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:32.241136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc3ce2-2409-4778-b53c-0bc07d9671e8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.245098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac290-48ed-4712-8038-20dbe6742399 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.245760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac290-48ed-4712-8038-20dbe6742399 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.246043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac290-48ed-4712-8038-20dbe6742399 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.246317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ac290-48ed-4712-8038-20dbe6742399 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.256924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac290-48ed-4712-8038-20dbe6742399 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.261698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ac290-48ed-4712-8038-20dbe6742399 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.261909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 811/1615] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:32.261909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986a3c7-7aae-4910-9619-75eb61d344a7 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.272742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 805/1616] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:32.272742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac290-48ed-4712-8038-20dbe6742399 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.278964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986a3c7-7aae-4910-9619-75eb61d344a7 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.281226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f389440-ad5a-4e67-9ab0-1ed2fc4eb7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.282007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f389440-ad5a-4e67-9ab0-1ed2fc4eb7bc admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.282247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f389440-ad5a-4e67-9ab0-1ed2fc4eb7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.282452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f389440-ad5a-4e67-9ab0-1ed2fc4eb7bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.283382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f389440-ad5a-4e67-9ab0-1ed2fc4eb7bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.285221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f389440-ad5a-4e67-9ab0-1ed2fc4eb7bc admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.296829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 812/1617] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:32.297774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f389440-ad5a-4e67-9ab0-1ed2fc4eb7bc admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.307055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:32.311811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f389440-ad5a-4e67-9ab0-1ed2fc4eb7bc admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.318434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831bc80-7da4-4ade-ae9f-e0e06639450f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.319497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831bc80-7da4-4ade-ae9f-e0e06639450f service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.320021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831bc80-7da4-4ade-ae9f-e0e06639450f service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.320468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831bc80-7da4-4ade-ae9f-e0e06639450f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.338728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ac290-48ed-4712-8038-20dbe6742399 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.343305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d3a36-aa2a-4d19-8747-ab6c712d3cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.343967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d3a36-aa2a-4d19-8747-ab6c712d3cdd service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.344254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d3a36-aa2a-4d19-8747-ab6c712d3cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.344529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d3a36-aa2a-4d19-8747-ab6c712d3cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.355873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d3a36-aa2a-4d19-8747-ab6c712d3cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.357349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d3a36-aa2a-4d19-8747-ab6c712d3cdd service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.367844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 806/1618] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:32.369406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d3a36-aa2a-4d19-8747-ab6c712d3cdd service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.385112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d3a36-aa2a-4d19-8747-ab6c712d3cdd service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.386845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831bc80-7da4-4ade-ae9f-e0e06639450f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.388450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831bc80-7da4-4ade-ae9f-e0e06639450f service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.390113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacbb05-48f3-4fea-957b-897db464a6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.390981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacbb05-48f3-4fea-957b-897db464a6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.391402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacbb05-48f3-4fea-957b-897db464a6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.391973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacbb05-48f3-4fea-957b-897db464a6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.398343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 813/1619] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:32.399196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831bc80-7da4-4ade-ae9f-e0e06639450f service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.405199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacbb05-48f3-4fea-957b-897db464a6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.406845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bacbb05-48f3-4fea-957b-897db464a6b1 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.414187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831bc80-7da4-4ade-ae9f-e0e06639450f service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.421828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 807/1620] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:32.422664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacbb05-48f3-4fea-957b-897db464a6b1 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.435638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203be47-8604-4806-aaac-c3aaada426fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.436851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203be47-8604-4806-aaac-c3aaada426fa admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.437380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203be47-8604-4806-aaac-c3aaada426fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.437888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c203be47-8604-4806-aaac-c3aaada426fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.441267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203be47-8604-4806-aaac-c3aaada426fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.444658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacbb05-48f3-4fea-957b-897db464a6b1 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.446008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c203be47-8604-4806-aaac-c3aaada426fa admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.452706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62de53d-c8f0-40bf-931f-fb7be908468c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.454393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62de53d-c8f0-40bf-931f-fb7be908468c service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.455743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62de53d-c8f0-40bf-931f-fb7be908468c service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.456991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62de53d-c8f0-40bf-931f-fb7be908468c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.482353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62de53d-c8f0-40bf-931f-fb7be908468c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.485768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62de53d-c8f0-40bf-931f-fb7be908468c service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.499795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 808/1621] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:32.500650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62de53d-c8f0-40bf-931f-fb7be908468c service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.513638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62de53d-c8f0-40bf-931f-fb7be908468c service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.519554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfcba2-7551-4f5b-a45f-0eba806ad45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.520331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfcba2-7551-4f5b-a45f-0eba806ad45a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.520702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfcba2-7551-4f5b-a45f-0eba806ad45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.521041 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfcba2-7551-4f5b-a45f-0eba806ad45a admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.521827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfcba2-7551-4f5b-a45f-0eba806ad45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.524682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cfcba2-7551-4f5b-a45f-0eba806ad45a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.583125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 814/1622] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:32.584668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203be47-8604-4806-aaac-c3aaada426fa admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.639734 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 809/1623] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:32.644188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfcba2-7551-4f5b-a45f-0eba806ad45a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.702008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c203be47-8604-4806-aaac-c3aaada426fa admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.750113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfcba2-7551-4f5b-a45f-0eba806ad45a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.756640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9aefb4-2c17-40c6-aba4-0ed6c8d4f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.758401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aefb4-2c17-40c6-aba4-0ed6c8d4f579 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.758737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aefb4-2c17-40c6-aba4-0ed6c8d4f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.759009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9aefb4-2c17-40c6-aba4-0ed6c8d4f579 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.759842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aefb4-2c17-40c6-aba4-0ed6c8d4f579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.762495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9aefb4-2c17-40c6-aba4-0ed6c8d4f579 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.777824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186ad4-6548-4355-820d-da2887dddb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.778732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186ad4-6548-4355-820d-da2887dddb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.779106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186ad4-6548-4355-820d-da2887dddb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.779439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81186ad4-6548-4355-820d-da2887dddb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.780329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81186ad4-6548-4355-820d-da2887dddb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.782207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81186ad4-6548-4355-820d-da2887dddb6a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.798093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 815/1624] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:32.803232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186ad4-6548-4355-820d-da2887dddb6a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.817698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81186ad4-6548-4355-820d-da2887dddb6a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.824184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928126a7-3214-483e-b1a5-8ff25bcdd83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.825222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928126a7-3214-483e-b1a5-8ff25bcdd83c admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.825837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928126a7-3214-483e-b1a5-8ff25bcdd83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.826264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928126a7-3214-483e-b1a5-8ff25bcdd83c admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.827257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928126a7-3214-483e-b1a5-8ff25bcdd83c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.829848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928126a7-3214-483e-b1a5-8ff25bcdd83c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.914642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 810/1625] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/users => generated 299 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:32.914642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5de754-11a3-4265-8990-ea4c608cb843 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.914642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5de754-11a3-4265-8990-ea4c608cb843 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.914642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5de754-11a3-4265-8990-ea4c608cb843 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.919075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 811/1626] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 26 12:47:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:47:32.919570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5de754-11a3-4265-8990-ea4c608cb843 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.934079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5de754-11a3-4265-8990-ea4c608cb843 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.945508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 816/1627] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/users => generated 296 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:32.945508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928126a7-3214-483e-b1a5-8ff25bcdd83c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:32.951432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952009-449c-4a18-85ac-1c504c099086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.952184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928126a7-3214-483e-b1a5-8ff25bcdd83c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:32.952487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952009-449c-4a18-85ac-1c504c099086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.952832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952009-449c-4a18-85ac-1c504c099086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.953208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00952009-449c-4a18-85ac-1c504c099086 admin admin] PATH_INFO: `/v3/projects/bd56ddcc403f4557859d6d5a92f06d4d/users/b01f6fb342804e4a967058491f2d6a44/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.961051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e60f1-1a63-4048-a610-fa25219c9ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:32.961707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e60f1-1a63-4048-a610-fa25219c9ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.963901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e60f1-1a63-4048-a610-fa25219c9ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.964042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e60f1-1a63-4048-a610-fa25219c9ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:32.964885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e60f1-1a63-4048-a610-fa25219c9ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.968669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e60f1-1a63-4048-a610-fa25219c9ef9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.970902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:32.984487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 817/1628] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:32 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:32.985505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952009-449c-4a18-85ac-1c504c099086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd56ddcc403f4557859d6d5a92f06d4d, user_id=b01f6fb342804e4a967058491f2d6a44, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:32.988321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d6a6-69a7-403c-b71b-45ba6ea25512 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:32.988321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d6a6-69a7-403c-b71b-45ba6ea25512 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:32.989698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00952009-449c-4a18-85ac-1c504c099086 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:32.989892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5d6a6-69a7-403c-b71b-45ba6ea25512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.008819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-24b5d6a6-69a7-403c-b71b-45ba6ea25512 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:33.010816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-24b5d6a6-69a7-403c-b71b-45ba6ea25512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:33.097017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 818/1629] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:47:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:33.098631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5d6a6-69a7-403c-b71b-45ba6ea25512 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:33.123302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5d6a6-69a7-403c-b71b-45ba6ea25512 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:33.123302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24009-1ae4-4d43-b961-8007c038cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:33.125049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24009-1ae4-4d43-b961-8007c038cd44 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.125744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24009-1ae4-4d43-b961-8007c038cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.126162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c24009-1ae4-4d43-b961-8007c038cd44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.127167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c24009-1ae4-4d43-b961-8007c038cd44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:33.128920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c24009-1ae4-4d43-b961-8007c038cd44 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:33.136977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 812/1630] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:32 2022] PUT /identity/v3/projects/bd56ddcc403f4557859d6d5a92f06d4d/users/b01f6fb342804e4a967058491f2d6a44/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:33.137964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952009-449c-4a18-85ac-1c504c099086 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:33.146142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 819/1631] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:33.148016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24009-1ae4-4d43-b961-8007c038cd44 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:33.156770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:33.228940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00952009-449c-4a18-85ac-1c504c099086 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:33.233989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbaa7c-c592-4f07-96c5-b2fb2bfc9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:33.234938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbaa7c-c592-4f07-96c5-b2fb2bfc9d4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.235220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbaa7c-c592-4f07-96c5-b2fb2bfc9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.235493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcbaa7c-c592-4f07-96c5-b2fb2bfc9d4b admin admin] PATH_INFO: `/v3/projects/28b3ddd05ee94214a74c78cece8238d1/users/28f698af23914a1196eea2748e21ab0f/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.243084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c24009-1ae4-4d43-b961-8007c038cd44 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:33.252728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbaa7c-c592-4f07-96c5-b2fb2bfc9d4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b3ddd05ee94214a74c78cece8238d1, user_id=28f698af23914a1196eea2748e21ab0f, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:33.256327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcbaa7c-c592-4f07-96c5-b2fb2bfc9d4b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:33.319724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0740a-4384-4daf-af2d-09b3aea64984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:33.320911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0740a-4384-4daf-af2d-09b3aea64984 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.322338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0740a-4384-4daf-af2d-09b3aea64984 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.322338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0740a-4384-4daf-af2d-09b3aea64984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.392351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 813/1632] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:33 2022] PUT /identity/v3/projects/28b3ddd05ee94214a74c78cece8238d1/users/28f698af23914a1196eea2748e21ab0f/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:33.393319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbaa7c-c592-4f07-96c5-b2fb2bfc9d4b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:33.460436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:33.494289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0740a-4384-4daf-af2d-09b3aea64984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:33.496034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0740a-4384-4daf-af2d-09b3aea64984 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:33.510156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 820/1633] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:33.511675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33699d-0f0b-4eb8-9b82-d90bf2e79ec9 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.512033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33699d-0f0b-4eb8-9b82-d90bf2e79ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.512443 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33699d-0f0b-4eb8-9b82-d90bf2e79ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.517714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcbaa7c-c592-4f07-96c5-b2fb2bfc9d4b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:33.528872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671f300-9e6d-4f76-8948-33cff92c1720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:33.529311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671f300-9e6d-4f76-8948-33cff92c1720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.530156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671f300-9e6d-4f76-8948-33cff92c1720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.530438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671f300-9e6d-4f76-8948-33cff92c1720 admin admin] PATH_INFO: `/v3/projects/a264293ce21d4f4bbed35e04b86820e4/users/b314cf4877cd48c4a06bf67c03b7f930/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.549270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ff33699d-0f0b-4eb8-9b82-d90bf2e79ec9 None None] MFA Rules not processed for user `b01f6fb342804e4a967058491f2d6a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:33.550886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ff33699d-0f0b-4eb8-9b82-d90bf2e79ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:33.562905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671f300-9e6d-4f76-8948-33cff92c1720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a264293ce21d4f4bbed35e04b86820e4, user_id=b314cf4877cd48c4a06bf67c03b7f930, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:33.565620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671f300-9e6d-4f76-8948-33cff92c1720 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:33.669590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 821/1634] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:33.671532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33699d-0f0b-4eb8-9b82-d90bf2e79ec9 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:33.685021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33699d-0f0b-4eb8-9b82-d90bf2e79ec9 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:33.694820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fdf76-492f-44f0-b58f-114cc6784d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:33.695789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fdf76-492f-44f0-b58f-114cc6784d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.696229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fdf76-492f-44f0-b58f-114cc6784d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.696720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fdf76-492f-44f0-b58f-114cc6784d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.697664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fdf76-492f-44f0-b58f-114cc6784d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:33.700054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fdf76-492f-44f0-b58f-114cc6784d3a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:33.714847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 822/1635] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:33.716097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fdf76-492f-44f0-b58f-114cc6784d3a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:33.731142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fdf76-492f-44f0-b58f-114cc6784d3a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:33.749419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 814/1636] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:33 2022] PUT /identity/v3/projects/a264293ce21d4f4bbed35e04b86820e4/users/b314cf4877cd48c4a06bf67c03b7f930/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:33.749419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671f300-9e6d-4f76-8948-33cff92c1720 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:33.755466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7367b-039c-44f3-b16f-44994e97ea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:33.758769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7367b-039c-44f3-b16f-44994e97ea8b admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.760477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7367b-039c-44f3-b16f-44994e97ea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.760984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7367b-039c-44f3-b16f-44994e97ea8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.763961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7367b-039c-44f3-b16f-44994e97ea8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:33.768984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7367b-039c-44f3-b16f-44994e97ea8b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:33.885644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671f300-9e6d-4f76-8948-33cff92c1720 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:33.891221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769c960-7852-4fa9-ba33-80c0dd9be29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:33.892235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c960-7852-4fa9-ba33-80c0dd9be29c admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.892576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c960-7852-4fa9-ba33-80c0dd9be29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.892912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769c960-7852-4fa9-ba33-80c0dd9be29c admin admin] PATH_INFO: `/v3/projects/28b3ddd05ee94214a74c78cece8238d1/users/28f698af23914a1196eea2748e21ab0f/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:33.896678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769c960-7852-4fa9-ba33-80c0dd9be29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b3ddd05ee94214a74c78cece8238d1, user_id=28f698af23914a1196eea2748e21ab0f, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:33.899254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769c960-7852-4fa9-ba33-80c0dd9be29c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:33.917600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 815/1637] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:33 2022] PUT /identity/v3/projects/28b3ddd05ee94214a74c78cece8238d1/users/28f698af23914a1196eea2748e21ab0f/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:33.922657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769c960-7852-4fa9-ba33-80c0dd9be29c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:33.930199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 823/1638] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:33 2022] POST /identity/v3/projects => generated 387 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:33.933374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72b1f-44bc-4abb-bf41-1352b3ba019d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:33.933870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72b1f-44bc-4abb-bf41-1352b3ba019d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:33.935477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe72b1f-44bc-4abb-bf41-1352b3ba019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.012270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-bfe72b1f-44bc-4abb-bf41-1352b3ba019d None None] MFA Rules not processed for user `28f698af23914a1196eea2748e21ab0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:34.013709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bfe72b1f-44bc-4abb-bf41-1352b3ba019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:34.016667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769c960-7852-4fa9-ba33-80c0dd9be29c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.045940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:34.088701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe426ea9-d495-4ea2-8f25-491085be501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.089384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426ea9-d495-4ea2-8f25-491085be501d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.089662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426ea9-d495-4ea2-8f25-491085be501d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.089943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe426ea9-d495-4ea2-8f25-491085be501d admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.090769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe426ea9-d495-4ea2-8f25-491085be501d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.092368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe426ea9-d495-4ea2-8f25-491085be501d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.103661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 816/1639] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:34.104534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 824/1640] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:34.105207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe426ea9-d495-4ea2-8f25-491085be501d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.108475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72b1f-44bc-4abb-bf41-1352b3ba019d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.119392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe426ea9-d495-4ea2-8f25-491085be501d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.128782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe72b1f-44bc-4abb-bf41-1352b3ba019d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.129497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97cefe-2ef5-4f8c-a001-0bddcea187ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.129497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97cefe-2ef5-4f8c-a001-0bddcea187ec admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.129497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97cefe-2ef5-4f8c-a001-0bddcea187ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.129885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97cefe-2ef5-4f8c-a001-0bddcea187ec admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.130440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97cefe-2ef5-4f8c-a001-0bddcea187ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.133202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97cefe-2ef5-4f8c-a001-0bddcea187ec admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.137910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79aa67-8e45-482f-9dba-3679830533bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.138888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79aa67-8e45-482f-9dba-3679830533bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.139170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79aa67-8e45-482f-9dba-3679830533bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.139440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be79aa67-8e45-482f-9dba-3679830533bf admin admin] PATH_INFO: `/v3/projects/a264293ce21d4f4bbed35e04b86820e4/users/b314cf4877cd48c4a06bf67c03b7f930/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.141573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79aa67-8e45-482f-9dba-3679830533bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a264293ce21d4f4bbed35e04b86820e4, user_id=b314cf4877cd48c4a06bf67c03b7f930, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.145131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be79aa67-8e45-482f-9dba-3679830533bf admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.156782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 825/1641] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:34 2022] PUT /identity/v3/projects/a264293ce21d4f4bbed35e04b86820e4/users/b314cf4877cd48c4a06bf67c03b7f930/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:34.157772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79aa67-8e45-482f-9dba-3679830533bf admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.171335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:34.244566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be79aa67-8e45-482f-9dba-3679830533bf admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.248892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5539ab-3483-4b38-857c-e7fad1b3e0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.249558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5539ab-3483-4b38-857c-e7fad1b3e0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.249829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5539ab-3483-4b38-857c-e7fad1b3e0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.250172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5539ab-3483-4b38-857c-e7fad1b3e0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.334707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 817/1642] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:34 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:34.338027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e625-8b7c-4e65-9fff-070f98a31620 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.338586 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e625-8b7c-4e65-9fff-070f98a31620 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.339340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60e625-8b7c-4e65-9fff-070f98a31620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.834102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0d60e625-8b7c-4e65-9fff-070f98a31620 None None] MFA Rules not processed for user `b314cf4877cd48c4a06bf67c03b7f930`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:34.835735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5539ab-3483-4b38-857c-e7fad1b3e0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.836639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0d60e625-8b7c-4e65-9fff-070f98a31620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:34.836893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5539ab-3483-4b38-857c-e7fad1b3e0e3 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.836893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 826/1643] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:34.836893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5539ab-3483-4b38-857c-e7fad1b3e0e3 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.837079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 818/1644] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:34.837079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60e625-8b7c-4e65-9fff-070f98a31620 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.837079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60e625-8b7c-4e65-9fff-070f98a31620 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.837291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5539ab-3483-4b38-857c-e7fad1b3e0e3 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.837360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.837360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.837360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.837360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] PATH_INFO: `/v3/users/16d8d5e517dc49a68661675fd1158ff4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.837613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d8d5e517dc49a68661675fd1158ff4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.837688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63a75d-67c4-446c-beb0-f879643d07c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.837688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a75d-67c4-446c-beb0-f879643d07c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.837688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a75d-67c4-446c-beb0-f879643d07c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.837688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63a75d-67c4-446c-beb0-f879643d07c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.837960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.838038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63a75d-67c4-446c-beb0-f879643d07c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.838038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63a75d-67c4-446c-beb0-f879643d07c2 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.838038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 827/1645] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:34.838038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63a75d-67c4-446c-beb0-f879643d07c2 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.838038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63a75d-67c4-446c-beb0-f879643d07c2 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.838408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975c7c9-7889-4bec-9be6-d79c10f2a84d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.838408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c7c9-7889-4bec-9be6-d79c10f2a84d service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.838408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c7c9-7889-4bec-9be6-d79c10f2a84d service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.838408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975c7c9-7889-4bec-9be6-d79c10f2a84d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.841414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975c7c9-7889-4bec-9be6-d79c10f2a84d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.841414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975c7c9-7889-4bec-9be6-d79c10f2a84d service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.841414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 828/1646] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:34.841414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975c7c9-7889-4bec-9be6-d79c10f2a84d service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.841414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975c7c9-7889-4bec-9be6-d79c10f2a84d service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.841741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102ad0d-d40a-4aae-b0ca-a0b36637887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.841741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102ad0d-d40a-4aae-b0ca-a0b36637887b admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.841741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102ad0d-d40a-4aae-b0ca-a0b36637887b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.841741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102ad0d-d40a-4aae-b0ca-a0b36637887b admin admin] PATH_INFO: `/v3/projects/7553e7950e244a2db9c1d80134f03593/users/0bc624e1d2914ed782459454386c3396/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.842008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102ad0d-d40a-4aae-b0ca-a0b36637887b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7553e7950e244a2db9c1d80134f03593, user_id=0bc624e1d2914ed782459454386c3396, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.842008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102ad0d-d40a-4aae-b0ca-a0b36637887b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.850351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 829/1647] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:34 2022] PUT /identity/v3/projects/7553e7950e244a2db9c1d80134f03593/users/0bc624e1d2914ed782459454386c3396/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:34.853122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102ad0d-d40a-4aae-b0ca-a0b36637887b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.924915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d8d5e517dc49a68661675fd1158ff4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:34.926345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d8d5e517dc49a68661675fd1158ff4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:34.927538 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d8d5e517dc49a68661675fd1158ff4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:34.942386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d8d5e517dc49a68661675fd1158ff4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:34.946824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102ad0d-d40a-4aae-b0ca-a0b36637887b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.950587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-11ba0cb4-f2ef-4a84-908b-14ddd0eb8e72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d8d5e517dc49a68661675fd1158ff4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:34.953199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.953865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.954142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.954417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.955328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.956895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:34.967957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 830/1648] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:34.972001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:34.973841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:34.987337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc158cb-80b7-4097-8914-770f8beb6198 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:34.993003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5c2a0-e2f0-4338-b3ee-e27e4e3aaa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:34.993942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c2a0-e2f0-4338-b3ee-e27e4e3aaa4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:34.994349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c2a0-e2f0-4338-b3ee-e27e4e3aaa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:34.994551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5c2a0-e2f0-4338-b3ee-e27e4e3aaa4d admin admin] PATH_INFO: `/v3/projects/7553e7950e244a2db9c1d80134f03593/users/0bc624e1d2914ed782459454386c3396/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:34.996727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5c2a0-e2f0-4338-b3ee-e27e4e3aaa4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7553e7950e244a2db9c1d80134f03593, user_id=0bc624e1d2914ed782459454386c3396, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:34.999486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5c2a0-e2f0-4338-b3ee-e27e4e3aaa4d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:35.011772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 831/1649] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:34 2022] PUT /identity/v3/projects/7553e7950e244a2db9c1d80134f03593/users/0bc624e1d2914ed782459454386c3396/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:35.022737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3febfc-f6e9-4f90-8d0b-30ae8f17c3c8 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.022950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3febfc-f6e9-4f90-8d0b-30ae8f17c3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.023292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3febfc-f6e9-4f90-8d0b-30ae8f17c3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.056499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 819/1650] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:47:34 2022] DELETE /identity/v3/users/16d8d5e517dc49a68661675fd1158ff4 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:35.057994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377e584-d99e-4908-a555-18d2620944e3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.058465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377e584-d99e-4908-a555-18d2620944e3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.058813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377e584-d99e-4908-a555-18d2620944e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.074691 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9b3febfc-f6e9-4f90-8d0b-30ae8f17c3c8 None None] MFA Rules not processed for user `0bc624e1d2914ed782459454386c3396`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:35.076040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9b3febfc-f6e9-4f90-8d0b-30ae8f17c3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.147951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d377e584-d99e-4908-a555-18d2620944e3 None None] MFA Rules not processed for user `6b148a9fa622488197fc684ccb665e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:35.162868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d377e584-d99e-4908-a555-18d2620944e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.196754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 832/1651] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:35.199399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b97d-3bce-4aa3-9e34-4ab6807b8330 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.199896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b97d-3bce-4aa3-9e34-4ab6807b8330 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.200648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7073b97d-3bce-4aa3-9e34-4ab6807b8330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.237705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7073b97d-3bce-4aa3-9e34-4ab6807b8330 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:35.241160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7073b97d-3bce-4aa3-9e34-4ab6807b8330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.269891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:35.349603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 820/1652] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:35.350310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377e584-d99e-4908-a555-18d2620944e3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:35.359942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d377e584-d99e-4908-a555-18d2620944e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.373087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:35.401057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 833/1653] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:35.402440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073b97d-3bce-4aa3-9e34-4ab6807b8330 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:35.411554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7073b97d-3bce-4aa3-9e34-4ab6807b8330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.462851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377e584-d99e-4908-a555-18d2620944e3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:35.475493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ee2d9-626e-4e2f-bfe0-1011919568c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:35.476256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee2d9-626e-4e2f-bfe0-1011919568c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.476573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee2d9-626e-4e2f-bfe0-1011919568c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.476857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee2d9-626e-4e2f-bfe0-1011919568c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.481646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a20ee2d9-626e-4e2f-bfe0-1011919568c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.492684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7073b97d-3bce-4aa3-9e34-4ab6807b8330 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:35.528829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdbceca-8811-4a86-aff3-87ef4add8158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:35.529752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbceca-8811-4a86-aff3-87ef4add8158 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.532458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbceca-8811-4a86-aff3-87ef4add8158 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.533351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdbceca-8811-4a86-aff3-87ef4add8158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.554293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbceca-8811-4a86-aff3-87ef4add8158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:35.556941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdbceca-8811-4a86-aff3-87ef4add8158 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:35.570895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 834/1654] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:35 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:35.573143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf51437-1fb3-47f5-9ab6-12f73f627d1f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.573582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf51437-1fb3-47f5-9ab6-12f73f627d1f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.573995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf51437-1fb3-47f5-9ab6-12f73f627d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.608446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ecf51437-1fb3-47f5-9ab6-12f73f627d1f None None] MFA Rules not processed for user `6b148a9fa622488197fc684ccb665e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:35.608446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ecf51437-1fb3-47f5-9ab6-12f73f627d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.635766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ee2d9-626e-4e2f-bfe0-1011919568c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:35.640292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 835/1655] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:35.643651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ee2d9-626e-4e2f-bfe0-1011919568c5 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:35.645484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf51437-1fb3-47f5-9ab6-12f73f627d1f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:35.648913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ecf51437-1fb3-47f5-9ab6-12f73f627d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.687742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 821/1656] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:35.688603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599e03-3a3f-42dd-ba65-899c56a41c30 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.688902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599e03-3a3f-42dd-ba65-899c56a41c30 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.689213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29599e03-3a3f-42dd-ba65-899c56a41c30 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.690927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 822/1657] 10.222.0.60 () {54 vars in 961 bytes} [Thu May 26 12:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:47:35.692314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29599e03-3a3f-42dd-ba65-899c56a41c30 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:35.702068 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-29599e03-3a3f-42dd-ba65-899c56a41c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.748497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf51437-1fb3-47f5-9ab6-12f73f627d1f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:35.752673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99ad6e-2427-4747-8b78-4a8812560049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:35.753343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99ad6e-2427-4747-8b78-4a8812560049 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.753624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99ad6e-2427-4747-8b78-4a8812560049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.753927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99ad6e-2427-4747-8b78-4a8812560049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.779879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99ad6e-2427-4747-8b78-4a8812560049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:35.781198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99ad6e-2427-4747-8b78-4a8812560049 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:35.796247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 836/1658] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:35.798252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daedd1-d4be-4e8d-beee-b4913df577d2 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.798981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daedd1-d4be-4e8d-beee-b4913df577d2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.799267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daedd1-d4be-4e8d-beee-b4913df577d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.824145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-c2daedd1-d4be-4e8d-beee-b4913df577d2 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:35.825406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c2daedd1-d4be-4e8d-beee-b4913df577d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:35.924303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29599e03-3a3f-42dd-ba65-899c56a41c30 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:35.932662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b06d-1e0e-4485-84ff-5eaf384da0c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:35.933488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b06d-1e0e-4485-84ff-5eaf384da0c1 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.933771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b06d-1e0e-4485-84ff-5eaf384da0c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.934047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9b06d-1e0e-4485-84ff-5eaf384da0c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.937853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 837/1659] 10.222.0.60 () {58 vars in 1058 bytes} [Thu May 26 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:35.944516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a33f-da7e-4ab0-a383-6e3b6c751fd4 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.945181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a33f-da7e-4ab0-a383-6e3b6c751fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.945847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8a33f-da7e-4ab0-a383-6e3b6c751fd4 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.945952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b06d-1e0e-4485-84ff-5eaf384da0c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:35.947656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 838/1660] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 26 12:47:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:47:35.948822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9b06d-1e0e-4485-84ff-5eaf384da0c1 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:35.975554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999752f-2db7-4a11-a7cb-7ab11609d815 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:35.976064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999752f-2db7-4a11-a7cb-7ab11609d815 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:35.977039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e999752f-2db7-4a11-a7cb-7ab11609d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:35.977144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 823/1661] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:36.000485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e999752f-2db7-4a11-a7cb-7ab11609d815 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:36.002422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e999752f-2db7-4a11-a7cb-7ab11609d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:36.032224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 839/1662] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:47:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:36.152659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b06d-1e0e-4485-84ff-5eaf384da0c1 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:36.169416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9b06d-1e0e-4485-84ff-5eaf384da0c1 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:36.174063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a521d1f-55f1-4a83-8654-2044047df789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:36.181425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521d1f-55f1-4a83-8654-2044047df789 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:36.181425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521d1f-55f1-4a83-8654-2044047df789 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:36.181425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a521d1f-55f1-4a83-8654-2044047df789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:36.191339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a521d1f-55f1-4a83-8654-2044047df789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:36.193805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a521d1f-55f1-4a83-8654-2044047df789 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:36.206413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 824/1663] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:36.868215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:36.879020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847de8-37e2-464b-8551-2be82bbf96b5 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:36.879378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847de8-37e2-464b-8551-2be82bbf96b5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:36.879658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b847de8-37e2-464b-8551-2be82bbf96b5 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:36.881184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 840/1664] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 26 12:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:47:36.888320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ca87-9758-4e0d-a56f-68f7caa18bbf None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:36.888620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ca87-9758-4e0d-a56f-68f7caa18bbf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:36.888929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760ca87-9758-4e0d-a56f-68f7caa18bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:36.936126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d760ca87-9758-4e0d-a56f-68f7caa18bbf None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:36.937400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d760ca87-9758-4e0d-a56f-68f7caa18bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:36.948837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 825/1665] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:36.957471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b847de8-37e2-464b-8551-2be82bbf96b5 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:36.959535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-1b847de8-37e2-464b-8551-2be82bbf96b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:36.976474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b847de8-37e2-464b-8551-2be82bbf96b5 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:36.980461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc4f3-1ede-4c1a-9c9d-947540b6072d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:36.981125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc4f3-1ede-4c1a-9c9d-947540b6072d service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:36.981407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc4f3-1ede-4c1a-9c9d-947540b6072d service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:36.987918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04cc4f3-1ede-4c1a-9c9d-947540b6072d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:36.995447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760ca87-9758-4e0d-a56f-68f7caa18bbf None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:36.995972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d760ca87-9758-4e0d-a56f-68f7caa18bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:37.008647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cc4f3-1ede-4c1a-9c9d-947540b6072d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.011072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04cc4f3-1ede-4c1a-9c9d-947540b6072d service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.041576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760ca87-9758-4e0d-a56f-68f7caa18bbf None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:37.041671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 841/1666] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:37.061164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:37.061164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.061164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.061164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] PATH_INFO: `/v3/projects/9d8acc50df024762ac7fe1ad90a51636` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.061467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d8acc50df024762ac7fe1ad90a51636)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.062357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: WARNING py.warnings [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:47:37.062357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: warnings.warn(msg) May 26 12:47:37.062357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: May 26 12:47:37.063585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.255303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d8acc50df024762ac7fe1ad90a51636', 'request_id': 'req-33a033da-39f4-421b-8c46-ab786f26864b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.287074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d8acc50df024762ac7fe1ad90a51636', 'request_id': 'req-33a033da-39f4-421b-8c46-ab786f26864b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.311822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d8acc50df024762ac7fe1ad90a51636', 'request_id': 'req-33a033da-39f4-421b-8c46-ab786f26864b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.338490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:37.406362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] The token cache is being invalidate because project 9d8acc50df024762ac7fe1ad90a51636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:37.406680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.407467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-33a033da-39f4-421b-8c46-ab786f26864b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.432472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 826/1667] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:47:36 2022] DELETE /identity/v3/projects/9d8acc50df024762ac7fe1ad90a51636 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:37.441540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc4f3-1ede-4c1a-9c9d-947540b6072d service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:37.468500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04cc4f3-1ede-4c1a-9c9d-947540b6072d service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:37.609301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:37.610343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:37.610949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:37.611274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] PATH_INFO: `/v3/users/28f698af23914a1196eea2748e21ab0f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:37.615717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28f698af23914a1196eea2748e21ab0f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:37.616856 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: WARNING py.warnings [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 12:47:37.616856 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: warnings.warn(msg) May 26 12:47:37.616856 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: May 26 12:47:37.618966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:37.933264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28f698af23914a1196eea2748e21ab0f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:37.935651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28f698af23914a1196eea2748e21ab0f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:38.027531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28f698af23914a1196eea2748e21ab0f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:38.128368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28f698af23914a1196eea2748e21ab0f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:38.129774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28f698af23914a1196eea2748e21ab0f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:38.184863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71a66-df49-471f-bb81-52399043f0bf None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.186493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71a66-df49-471f-bb81-52399043f0bf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.186879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b71a66-df49-471f-bb81-52399043f0bf None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.188632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 827/1668] 10.222.0.60 () {54 vars in 960 bytes} [Thu May 26 12:47:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 12:47:38.196878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ab4e7-c272-47ec-bced-5a13f4c1ce10 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.197423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ab4e7-c272-47ec-bced-5a13f4c1ce10 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.197864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ab4e7-c272-47ec-bced-5a13f4c1ce10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.237902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8c6ab4e7-c272-47ec-bced-5a13f4c1ce10 None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:38.239284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8c6ab4e7-c272-47ec-bced-5a13f4c1ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:38.290192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 842/1669] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:47:37 2022] DELETE /identity/v3/users/28f698af23914a1196eea2748e21ab0f => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:38.387011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 828/1670] 10.222.0.60 () {58 vars in 1057 bytes} [Thu May 26 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:38.399859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:38.538076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8afd8-762e-46c2-a375-7ca683ce3951 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:38.547174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:38.562595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:38.562777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:38.563045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:38.567229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:38.595198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:38.596821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:38.613617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 843/1671] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:39.020441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ab4e7-c272-47ec-bced-5a13f4c1ce10 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:39.022735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8c6ab4e7-c272-47ec-bced-5a13f4c1ce10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:39.178929 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:39.196506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ab4e7-c272-47ec-bced-5a13f4c1ce10 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:39.496713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45004b4a-09a1-400b-bae7-9e0fbcb27687 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:39.497602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004b4a-09a1-400b-bae7-9e0fbcb27687 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.497961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004b4a-09a1-400b-bae7-9e0fbcb27687 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.498377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45004b4a-09a1-400b-bae7-9e0fbcb27687 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.504968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45004b4a-09a1-400b-bae7-9e0fbcb27687 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:39.555589 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:39.559652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:39.669403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45004b4a-09a1-400b-bae7-9e0fbcb27687 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:39.671246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45004b4a-09a1-400b-bae7-9e0fbcb27687 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:39.713407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 829/1672] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:39.763549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b8598b-aea1-4849-96e6-425fc1a7e9c4 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:39.779381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:39.780495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:39.780834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:39.781122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] PATH_INFO: `/v3/projects/28b3ddd05ee94214a74c78cece8238d1` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:39.783575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b3ddd05ee94214a74c78cece8238d1)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:39.790377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:39.955871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b3ddd05ee94214a74c78cece8238d1', 'request_id': 'req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:39.971023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b3ddd05ee94214a74c78cece8238d1', 'request_id': 'req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:40.008317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:40.085409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b3ddd05ee94214a74c78cece8238d1', 'request_id': 'req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:40.137832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] The token cache is being invalidate because project 28b3ddd05ee94214a74c78cece8238d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:40.137832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:40.137832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5ac3a142-599e-48ac-81c3-cae1a69f4dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:40.142161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 844/1673] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:47:39 2022] DELETE /identity/v3/projects/28b3ddd05ee94214a74c78cece8238d1 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:40.149191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7372-eb24-4959-b0c0-ee5a99700661 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:40.149492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7372-eb24-4959-b0c0-ee5a99700661 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:40.149900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a7372-eb24-4959-b0c0-ee5a99700661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:40.190022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d12a7372-eb24-4959-b0c0-ee5a99700661 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:40.191296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d12a7372-eb24-4959-b0c0-ee5a99700661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:40.373177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 830/1674] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:40.374155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f835-5c47-421c-bebb-aad08d383ea3 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:40.374618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f835-5c47-421c-bebb-aad08d383ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:40.375210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434f835-5c47-421c-bebb-aad08d383ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:40.434417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-6434f835-5c47-421c-bebb-aad08d383ea3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:40.440573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6434f835-5c47-421c-bebb-aad08d383ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:40.471997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 845/1675] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:40.474252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7372-eb24-4959-b0c0-ee5a99700661 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:40.492057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a7372-eb24-4959-b0c0-ee5a99700661 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:40.509853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:40.511764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:40.512295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:40.512772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:40.514079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:40.515731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:40.518211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:40.565188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:40.571626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 831/1676] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:40.577380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f835-5c47-421c-bebb-aad08d383ea3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:40.616555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434f835-5c47-421c-bebb-aad08d383ea3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:40.631906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359ee28-554f-4352-8177-ba131a1f7190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:40.632873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ee28-554f-4352-8177-ba131a1f7190 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:40.633351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ee28-554f-4352-8177-ba131a1f7190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:40.633864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359ee28-554f-4352-8177-ba131a1f7190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:40.634889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ee28-554f-4352-8177-ba131a1f7190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:40.638570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359ee28-554f-4352-8177-ba131a1f7190 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:40.772543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 846/1677] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:40 2022] POST /identity/v3/projects => generated 391 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:40.776986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:40.801957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76c87b-a5fc-4a64-868c-edd6c8864a75 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:41.064425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033f56d-860f-4049-881d-58f15e949eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:41.065134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f56d-860f-4049-881d-58f15e949eee admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:41.066674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f56d-860f-4049-881d-58f15e949eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:41.066968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033f56d-860f-4049-881d-58f15e949eee admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:41.067815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033f56d-860f-4049-881d-58f15e949eee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:41.069825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033f56d-860f-4049-881d-58f15e949eee admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:41.193772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 832/1678] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:40 2022] POST /identity/v3/users => generated 296 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:41.198592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359ee28-554f-4352-8177-ba131a1f7190 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:41.212354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359ee28-554f-4352-8177-ba131a1f7190 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:41.220501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab1ac-9fd0-4d6e-a5e3-eb03acbf1715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:41.221486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab1ac-9fd0-4d6e-a5e3-eb03acbf1715 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:41.221947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab1ac-9fd0-4d6e-a5e3-eb03acbf1715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:41.222430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ab1ac-9fd0-4d6e-a5e3-eb03acbf1715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:41.225047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ab1ac-9fd0-4d6e-a5e3-eb03acbf1715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:41.226908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ab1ac-9fd0-4d6e-a5e3-eb03acbf1715 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:41.241891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 847/1679] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:47:41.248612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033f56d-860f-4049-881d-58f15e949eee admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:41.269044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033f56d-860f-4049-881d-58f15e949eee admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:41.285475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100ef37-67c3-40cb-8b27-6797a09015a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:41.287508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ef37-67c3-40cb-8b27-6797a09015a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:41.287996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ef37-67c3-40cb-8b27-6797a09015a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:41.288508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100ef37-67c3-40cb-8b27-6797a09015a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:41.290191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100ef37-67c3-40cb-8b27-6797a09015a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:41.292217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100ef37-67c3-40cb-8b27-6797a09015a1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:41.314805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 833/1680] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:41.324962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab1ac-9fd0-4d6e-a5e3-eb03acbf1715 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:41.337573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ab1ac-9fd0-4d6e-a5e3-eb03acbf1715 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:41.344217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6d92-1473-4e06-9e2e-7df40a88ba96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:41.344578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6d92-1473-4e06-9e2e-7df40a88ba96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:41.344857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6d92-1473-4e06-9e2e-7df40a88ba96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:41.345126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6d92-1473-4e06-9e2e-7df40a88ba96 admin admin] PATH_INFO: `/v3/projects/960bc103d43245d680ed381d21b298ae/users/61b80aa258aa466e985b421a3dc2c606/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:41.369086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb6d92-1473-4e06-9e2e-7df40a88ba96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=960bc103d43245d680ed381d21b298ae, user_id=61b80aa258aa466e985b421a3dc2c606, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:41.372508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb6d92-1473-4e06-9e2e-7df40a88ba96 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:41.525652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 848/1681] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:41 2022] PUT /identity/v3/projects/960bc103d43245d680ed381d21b298ae/users/61b80aa258aa466e985b421a3dc2c606/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:41.539428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b9e2-c213-492a-8bef-9c9e7d04f078 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:41.539428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b9e2-c213-492a-8bef-9c9e7d04f078 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:41.539855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6b9e2-c213-492a-8bef-9c9e7d04f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:41.603787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c6f6b9e2-c213-492a-8bef-9c9e7d04f078 None None] MFA Rules not processed for user `61b80aa258aa466e985b421a3dc2c606`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:41.608300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c6f6b9e2-c213-492a-8bef-9c9e7d04f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:41.739513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 834/1682] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:41.739784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6d92-1473-4e06-9e2e-7df40a88ba96 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:41.903425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6d92-1473-4e06-9e2e-7df40a88ba96 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:41.916591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770bad-b651-46ee-b08e-490dd924b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:41.917353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770bad-b651-46ee-b08e-490dd924b16a admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:41.917643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770bad-b651-46ee-b08e-490dd924b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:41.917922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4770bad-b651-46ee-b08e-490dd924b16a admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:41.918711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4770bad-b651-46ee-b08e-490dd924b16a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:41.920648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4770bad-b651-46ee-b08e-490dd924b16a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:42.156163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 849/1683] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:41 2022] POST /identity/v3/projects => generated 393 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:42.162689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6b9e2-c213-492a-8bef-9c9e7d04f078 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:42.175866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6b9e2-c213-492a-8bef-9c9e7d04f078 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:42.274686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e3485-346e-4a72-a7da-68097495665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:42.275408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3485-346e-4a72-a7da-68097495665a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:42.280968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3485-346e-4a72-a7da-68097495665a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:42.281500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e3485-346e-4a72-a7da-68097495665a admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:42.282268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e3485-346e-4a72-a7da-68097495665a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:42.284286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e3485-346e-4a72-a7da-68097495665a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:42.407113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 835/1684] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:42 2022] POST /identity/v3/users => generated 303 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:47:42.411225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770bad-b651-46ee-b08e-490dd924b16a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:42.423315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4770bad-b651-46ee-b08e-490dd924b16a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:42.434114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b7853-0acb-4b15-9316-2c97608cc842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:42.435485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b7853-0acb-4b15-9316-2c97608cc842 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:42.435876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b7853-0acb-4b15-9316-2c97608cc842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:42.438254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151b7853-0acb-4b15-9316-2c97608cc842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:42.439549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b7853-0acb-4b15-9316-2c97608cc842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:42.445692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151b7853-0acb-4b15-9316-2c97608cc842 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:42.466902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 850/1685] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:42.467817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e3485-346e-4a72-a7da-68097495665a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:42.479289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e3485-346e-4a72-a7da-68097495665a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:42.484510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728703d-6637-4d54-a495-a2febc8ff7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:42.486663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728703d-6637-4d54-a495-a2febc8ff7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:42.487167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728703d-6637-4d54-a495-a2febc8ff7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:42.487631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728703d-6637-4d54-a495-a2febc8ff7b3 admin admin] PATH_INFO: `/v3/projects/a7958c6fca6045d78d9d0fb72d70621d/users/d55b99aad8c04ddd9ddb2d536b234c47/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:42.543618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728703d-6637-4d54-a495-a2febc8ff7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7958c6fca6045d78d9d0fb72d70621d, user_id=d55b99aad8c04ddd9ddb2d536b234c47, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:42.546619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728703d-6637-4d54-a495-a2febc8ff7b3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:42.626131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 836/1686] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:42 2022] PUT /identity/v3/projects/a7958c6fca6045d78d9d0fb72d70621d/users/d55b99aad8c04ddd9ddb2d536b234c47/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:47:42.630957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b7853-0acb-4b15-9316-2c97608cc842 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:42.657754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151b7853-0acb-4b15-9316-2c97608cc842 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:42.751305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc71a2-4dc2-4e0f-a639-76272a1494c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:42.752947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc71a2-4dc2-4e0f-a639-76272a1494c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:42.753425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc71a2-4dc2-4e0f-a639-76272a1494c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:42.753884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc71a2-4dc2-4e0f-a639-76272a1494c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:42.756004 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc71a2-4dc2-4e0f-a639-76272a1494c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:42.758728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc71a2-4dc2-4e0f-a639-76272a1494c3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:42.775697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 851/1687] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:47:42.781611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728703d-6637-4d54-a495-a2febc8ff7b3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:42.792910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728703d-6637-4d54-a495-a2febc8ff7b3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:42.798618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:42.799691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:42.800150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:42.800534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] PATH_INFO: `/v3/projects/a7958c6fca6045d78d9d0fb72d70621d/users/d55b99aad8c04ddd9ddb2d536b234c47/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:42.803640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7958c6fca6045d78d9d0fb72d70621d, user_id=d55b99aad8c04ddd9ddb2d536b234c47, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:42.806543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:42.823159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 837/1688] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:47:42 2022] PUT /identity/v3/projects/a7958c6fca6045d78d9d0fb72d70621d/users/d55b99aad8c04ddd9ddb2d536b234c47/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:42.837349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e948e-487c-4f7d-a616-06ad3e2e708a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:42.837591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e948e-487c-4f7d-a616-06ad3e2e708a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:42.838319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371e948e-487c-4f7d-a616-06ad3e2e708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:42.913284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-371e948e-487c-4f7d-a616-06ad3e2e708a None None] MFA Rules not processed for user `d55b99aad8c04ddd9ddb2d536b234c47`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:42.914780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-371e948e-487c-4f7d-a616-06ad3e2e708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.118081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:43.165202 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 852/1689] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:43.241383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:43.250137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:43.263086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.427911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340b4ea-685a-4676-b931-9b17b660cea3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:43.430122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827177d-3c1b-40c2-ada9-305f90ae1ecc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.430920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827177d-3c1b-40c2-ada9-305f90ae1ecc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.431596 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827177d-3c1b-40c2-ada9-305f90ae1ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.434894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:43.435575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.435913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.436190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.489921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:43.491330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:43.492848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7827177d-3c1b-40c2-ada9-305f90ae1ecc None None] MFA Rules not processed for user `98a275f65a3544a5b073fbf1ee10034b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:43.494134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7827177d-3c1b-40c2-ada9-305f90ae1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.506288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 838/1690] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:43.612532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:43.612532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.624688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79cf8d-7f64-4f95-82ee-3f5ebdc85228 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:43.628750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 853/1691] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:47:43.634955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6b6f1-fff7-43cb-9199-1cb57ab19c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:43.635553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827177d-3c1b-40c2-ada9-305f90ae1ecc None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:43.636591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6b6f1-fff7-43cb-9199-1cb57ab19c78 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.637008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6b6f1-fff7-43cb-9199-1cb57ab19c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.637116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7827177d-3c1b-40c2-ada9-305f90ae1ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.637531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6b6f1-fff7-43cb-9199-1cb57ab19c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.673481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:43.761958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6b6f1-fff7-43cb-9199-1cb57ab19c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:43.775008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6b6f1-fff7-43cb-9199-1cb57ab19c78 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:43.776013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827177d-3c1b-40c2-ada9-305f90ae1ecc None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:43.784055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b93e4c-7ed4-4990-b39f-9aab2514dd7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:43.786323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 839/1692] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:47:43.787880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5dca7-5cca-4d44-98dc-b5352c9a1cca None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.788178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5dca7-5cca-4d44-98dc-b5352c9a1cca None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.788458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5dca7-5cca-4d44-98dc-b5352c9a1cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.789146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b93e4c-7ed4-4990-b39f-9aab2514dd7e service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.803076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b93e4c-7ed4-4990-b39f-9aab2514dd7e service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.803796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b93e4c-7ed4-4990-b39f-9aab2514dd7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.817523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-31b5dca7-5cca-4d44-98dc-b5352c9a1cca None None] MFA Rules not processed for user `e24e8e8d0b8042bfb7ee7881aa8a16c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:43.818740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-31b5dca7-5cca-4d44-98dc-b5352c9a1cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.819991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b93e4c-7ed4-4990-b39f-9aab2514dd7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:43.822582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b93e4c-7ed4-4990-b39f-9aab2514dd7e service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:43.846877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 854/1693] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:43.899956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 840/1694] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:43.905025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b25b-8f0e-411c-80e7-0dff503403fe None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:43.905310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b25b-8f0e-411c-80e7-0dff503403fe None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:43.905610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b25b-8f0e-411c-80e7-0dff503403fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:43.940190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7f75b25b-8f0e-411c-80e7-0dff503403fe None None] MFA Rules not processed for user `e24e8e8d0b8042bfb7ee7881aa8a16c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:43.942822 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7f75b25b-8f0e-411c-80e7-0dff503403fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.952270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 855/1695] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:43.966945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5dca7-5cca-4d44-98dc-b5352c9a1cca None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:43.968393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-31b5dca7-5cca-4d44-98dc-b5352c9a1cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:43.999596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5dca7-5cca-4d44-98dc-b5352c9a1cca None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:44.012089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2905ecbd-1a41-41be-9cd7-1eb04a357abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:44.012771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ecbd-1a41-41be-9cd7-1eb04a357abe service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.013059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ecbd-1a41-41be-9cd7-1eb04a357abe service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.013338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2905ecbd-1a41-41be-9cd7-1eb04a357abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.030954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905ecbd-1a41-41be-9cd7-1eb04a357abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:44.032583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2905ecbd-1a41-41be-9cd7-1eb04a357abe service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:44.045009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 841/1696] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:44.865650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aaafc-f7de-4e91-8cf7-0aa217ae1275 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.866843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aaafc-f7de-4e91-8cf7-0aa217ae1275 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.867340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2aaafc-f7de-4e91-8cf7-0aa217ae1275 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.869599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 856/1697] 10.222.0.60 () {54 vars in 912 bytes} [Thu May 26 12:47:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:47:44.886492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcaa48-a34b-4932-a4b9-0a5618dce548 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:44.886990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcaa48-a34b-4932-a4b9-0a5618dce548 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:44.887224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbcaa48-a34b-4932-a4b9-0a5618dce548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:44.911250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3dbcaa48-a34b-4932-a4b9-0a5618dce548 None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:44.912445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3dbcaa48-a34b-4932-a4b9-0a5618dce548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:44.990767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 842/1698] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:45.006762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aaafc-f7de-4e91-8cf7-0aa217ae1275 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:45.009129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bc2aaafc-f7de-4e91-8cf7-0aa217ae1275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:45.037332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2aaafc-f7de-4e91-8cf7-0aa217ae1275 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:45.052207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd88e3-9e5b-4b21-9e08-9fd0ba66bb59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:45.053207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd88e3-9e5b-4b21-9e08-9fd0ba66bb59 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.053759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd88e3-9e5b-4b21-9e08-9fd0ba66bb59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.054053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd88e3-9e5b-4b21-9e08-9fd0ba66bb59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.063873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd88e3-9e5b-4b21-9e08-9fd0ba66bb59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:45.065486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd88e3-9e5b-4b21-9e08-9fd0ba66bb59 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:45.075358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 857/1699] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:45.439899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:45.642146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:45.940566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9b29-40c1-4e43-a9bf-28852afa656b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:45.940969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9b29-40c1-4e43-a9bf-28852afa656b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:45.940969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c9b29-40c1-4e43-a9bf-28852afa656b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:45.980034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-142c9b29-40c1-4e43-a9bf-28852afa656b None None] MFA Rules not processed for user `e24e8e8d0b8042bfb7ee7881aa8a16c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:45.981274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-142c9b29-40c1-4e43-a9bf-28852afa656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:46.020637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 843/1700] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:47.782137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e21eb-2225-4b19-9771-fbebe0591557 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:47.783588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e21eb-2225-4b19-9771-fbebe0591557 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:47.784262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e21eb-2225-4b19-9771-fbebe0591557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:47.876174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-556e21eb-2225-4b19-9771-fbebe0591557 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:47.879831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-556e21eb-2225-4b19-9771-fbebe0591557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:48.084910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 858/1701] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:48.691610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9b29-40c1-4e43-a9bf-28852afa656b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:48.691610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-142c9b29-40c1-4e43-a9bf-28852afa656b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:48.973155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c9b29-40c1-4e43-a9bf-28852afa656b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:48.987945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:48.989301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:48.992762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:48.992762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:49.018304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:49.018797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:49.042254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 844/1702] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:47:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:47:49.224768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc230d3-2339-4df2-9114-0e0fd797000d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:49.225642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc230d3-2339-4df2-9114-0e0fd797000d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:49.225642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc230d3-2339-4df2-9114-0e0fd797000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:49.302547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-bdc230d3-2339-4df2-9114-0e0fd797000d None None] MFA Rules not processed for user `98a275f65a3544a5b073fbf1ee10034b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:49.309508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bdc230d3-2339-4df2-9114-0e0fd797000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:49.360368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 859/1703] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:55.805284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:55.805923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:55.845269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:55.979116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd32f0e-51d6-4363-a219-df685546bb41 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:55.992279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:55.993545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:55.996151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:55.996545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] PATH_INFO: `/v3/users/3a709d15f5534cf398c2ead09627b09c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:55.999040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a709d15f5534cf398c2ead09627b09c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:56.003274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:56.312039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a709d15f5534cf398c2ead09627b09c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.313145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a709d15f5534cf398c2ead09627b09c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.313892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a709d15f5534cf398c2ead09627b09c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.336110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a709d15f5534cf398c2ead09627b09c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.346218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a709d15f5534cf398c2ead09627b09c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:56.466570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 845/1704] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:47:55 2022] DELETE /identity/v3/users/3a709d15f5534cf398c2ead09627b09c => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:56.471217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f87a-b0be-4d7c-976d-1e8491a50514 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:56.471730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f87a-b0be-4d7c-976d-1e8491a50514 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:56.471829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f87a-b0be-4d7c-976d-1e8491a50514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:56.495448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-91d1f87a-b0be-4d7c-976d-1e8491a50514 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:56.498694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-91d1f87a-b0be-4d7c-976d-1e8491a50514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:56.556899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:56.572587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 860/1705] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:56.585745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:56.590388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:56.671925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f87a-b0be-4d7c-976d-1e8491a50514 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:56.674072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-91d1f87a-b0be-4d7c-976d-1e8491a50514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:56.736975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca544-785f-4073-81e0-5e1315429d9a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:56.741347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:56.742497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:56.749092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:56.749092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:56.760730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:56.762898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:56.782577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f87a-b0be-4d7c-976d-1e8491a50514 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:56.783956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 846/1706] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:56.791868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44505335-9f57-4e4c-8943-0633ddaeab4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:56.792635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44505335-9f57-4e4c-8943-0633ddaeab4d service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:56.794991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44505335-9f57-4e4c-8943-0633ddaeab4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:56.795534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44505335-9f57-4e4c-8943-0633ddaeab4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:56.800821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-44505335-9f57-4e4c-8943-0633ddaeab4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:56.801654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:56.803564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:56.835507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7ab13-64d1-4319-9fad-6f82734231bc service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:56.853094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:56.854008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:56.854295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:56.854608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] PATH_INFO: `/v3/users/61b80aa258aa466e985b421a3dc2c606` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:56.857655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b80aa258aa466e985b421a3dc2c606)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:56.860156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:56.942824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44505335-9f57-4e4c-8943-0633ddaeab4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:56.944480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44505335-9f57-4e4c-8943-0633ddaeab4d service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:56.956262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 861/1707] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:57.026468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:57.150564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b80aa258aa466e985b421a3dc2c606'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.151675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b80aa258aa466e985b421a3dc2c606'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.152540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b80aa258aa466e985b421a3dc2c606'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.179436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b80aa258aa466e985b421a3dc2c606'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.195731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b80aa258aa466e985b421a3dc2c606'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:57.627276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 847/1708] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:47:56 2022] DELETE /identity/v3/users/61b80aa258aa466e985b421a3dc2c606 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:57.632792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1531a3-44d3-40ae-ac92-9b5120c2b399 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:57.633384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1531a3-44d3-40ae-ac92-9b5120c2b399 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:57.633384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1531a3-44d3-40ae-ac92-9b5120c2b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:57.656710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ee1531a3-44d3-40ae-ac92-9b5120c2b399 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:57.675871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ee1531a3-44d3-40ae-ac92-9b5120c2b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:57.747074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 862/1709] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:57.757317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:57.758823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:57.851098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d888a28-d5e5-4068-b58f-d088414fc6e5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:57.855102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f22c2-c05f-4ebe-b1f6-e7d325049dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:57.856349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f22c2-c05f-4ebe-b1f6-e7d325049dda service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:57.856349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f22c2-c05f-4ebe-b1f6-e7d325049dda service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:57.856575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f22c2-c05f-4ebe-b1f6-e7d325049dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:57.868021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f22c2-c05f-4ebe-b1f6-e7d325049dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:57.869576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f22c2-c05f-4ebe-b1f6-e7d325049dda service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:57.890565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 848/1710] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:47:58.232645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1531a3-44d3-40ae-ac92-9b5120c2b399 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:58.234304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ee1531a3-44d3-40ae-ac92-9b5120c2b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:58.265906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1531a3-44d3-40ae-ac92-9b5120c2b399 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:58.273939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:58.275150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:58.275963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:58.276398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] PATH_INFO: `/v3/projects/87a842d33e6043a99b1cfa595a06c723` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:58.277750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87a842d33e6043a99b1cfa595a06c723)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:58.280557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:58.515795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:58.527519 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a842d33e6043a99b1cfa595a06c723', 'request_id': 'req-400cd749-1634-4e1e-b8bb-163425fe71d5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.537734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a842d33e6043a99b1cfa595a06c723', 'request_id': 'req-400cd749-1634-4e1e-b8bb-163425fe71d5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.731348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a842d33e6043a99b1cfa595a06c723', 'request_id': 'req-400cd749-1634-4e1e-b8bb-163425fe71d5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.748425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] The token cache is being invalidate because project 87a842d33e6043a99b1cfa595a06c723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:58.748967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.749633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-400cd749-1634-4e1e-b8bb-163425fe71d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:58.751251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 863/1711] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:47:58 2022] DELETE /identity/v3/projects/87a842d33e6043a99b1cfa595a06c723 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:58.757648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fffb3a-6a33-4a5b-9608-a0755607cb07 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:58.758130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fffb3a-6a33-4a5b-9608-a0755607cb07 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:58.758512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fffb3a-6a33-4a5b-9608-a0755607cb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:58.789518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-77fffb3a-6a33-4a5b-9608-a0755607cb07 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:58.795821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-77fffb3a-6a33-4a5b-9608-a0755607cb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:58.877097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 849/1712] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:58.888795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9b02e-07a8-4df7-8215-876f131a75cb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:58.888795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9b02e-07a8-4df7-8215-876f131a75cb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:58.888795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9b02e-07a8-4df7-8215-876f131a75cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:58.908057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-0fc9b02e-07a8-4df7-8215-876f131a75cb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:47:58.909277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0fc9b02e-07a8-4df7-8215-876f131a75cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:58.918818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 864/1713] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:47:58.922927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fffb3a-6a33-4a5b-9608-a0755607cb07 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:58.934091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fffb3a-6a33-4a5b-9608-a0755607cb07 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:58.944378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9b02e-07a8-4df7-8215-876f131a75cb None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:58.945988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:58.947744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:58.947863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0fc9b02e-07a8-4df7-8215-876f131a75cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:58.948308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:58.948886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:58.949775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:47:58.950182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:58.960159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:58.972181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9b02e-07a8-4df7-8215-876f131a75cb None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:58.973951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:58.975043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:58.975976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:58.976689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] PATH_INFO: `/v3/projects/960bc103d43245d680ed381d21b298ae` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:58.978850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] RBAC: Authorizing `identity:delete_project(project_id=960bc103d43245d680ed381d21b298ae)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:58.981032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:59.015412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 850/1714] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:47:59.017091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:59.041978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c418f-391a-4416-9da2-6ffeb532b2b9 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:59.068574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375156-4ec6-4977-91e7-c3cef2ed7407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:59.068574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375156-4ec6-4977-91e7-c3cef2ed7407 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.068574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375156-4ec6-4977-91e7-c3cef2ed7407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.068574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f375156-4ec6-4977-91e7-c3cef2ed7407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.068980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f375156-4ec6-4977-91e7-c3cef2ed7407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:59.068980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f375156-4ec6-4977-91e7-c3cef2ed7407 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:59.204710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 851/1715] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:47:59 2022] POST /identity/v3/projects => generated 369 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:59.209114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375156-4ec6-4977-91e7-c3cef2ed7407 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:59.234827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '960bc103d43245d680ed381d21b298ae', 'request_id': 'req-7da70d9c-befb-4b60-930c-b49d6c6ce142'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.242969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '960bc103d43245d680ed381d21b298ae', 'request_id': 'req-7da70d9c-befb-4b60-930c-b49d6c6ce142'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.262705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:47:59.360723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f375156-4ec6-4977-91e7-c3cef2ed7407 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:59.394066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '960bc103d43245d680ed381d21b298ae', 'request_id': 'req-7da70d9c-befb-4b60-930c-b49d6c6ce142'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.409502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] The token cache is being invalidate because project 960bc103d43245d680ed381d21b298ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:47:59.409938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.411616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:47:59.422777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 865/1716] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:47:58 2022] DELETE /identity/v3/projects/960bc103d43245d680ed381d21b298ae => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:47:59.427595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:59.429701 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:59.438285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:59.439065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.439300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.439573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.440405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:59.443671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:59.563074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da70d9c-befb-4b60-930c-b49d6c6ce142 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:59.563074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:59.563074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.563074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.563422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] PATH_INFO: `/v3/users/d55b99aad8c04ddd9ddb2d536b234c47` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.563422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d55b99aad8c04ddd9ddb2d536b234c47)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:59.563422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:47:59.935784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 852/1717] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:47:59 2022] POST /identity/v3/users => generated 285 bytes in 726 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:47:59.935784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:47:59.945228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:47:59.952020 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95be36-dc9c-4ece-872a-4cbe2a21626a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:47:59.957181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:47:59.958668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:47:59.958957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:47:59.959235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] PATH_INFO: `/v3/users/13e852d405be45b6a4ae2182df0b91a7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:47:59.960475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e852d405be45b6a4ae2182df0b91a7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:47:59.962415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.143180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd55b99aad8c04ddd9ddb2d536b234c47'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.143984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd55b99aad8c04ddd9ddb2d536b234c47'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.150927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:00.154305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd55b99aad8c04ddd9ddb2d536b234c47'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.172694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd55b99aad8c04ddd9ddb2d536b234c47'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.173445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd55b99aad8c04ddd9ddb2d536b234c47'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.207408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e852d405be45b6a4ae2182df0b91a7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.208737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e852d405be45b6a4ae2182df0b91a7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.209544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e852d405be45b6a4ae2182df0b91a7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.236056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e852d405be45b6a4ae2182df0b91a7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.253415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f97a2f1-f4d7-4bfe-9126-c306b8cca853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e852d405be45b6a4ae2182df0b91a7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:00.321437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 866/1718] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:47:59 2022] DELETE /identity/v3/users/d55b99aad8c04ddd9ddb2d536b234c47 => generated 0 bytes in 898 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:00.322066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.325362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:00.481895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ab45-d7bd-4c2b-8e2b-fcfd0a554553 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.487117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.488682 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.488974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.489309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.490549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.492417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.517503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 867/1719] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:00.522678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 853/1720] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:47:59 2022] DELETE /identity/v3/users/13e852d405be45b6a4ae2182df0b91a7 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:00.528155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dbcfd-4471-4de0-a8ae-fe082e46e1ee None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.528465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dbcfd-4471-4de0-a8ae-fe082e46e1ee None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.528749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dbcfd-4471-4de0-a8ae-fe082e46e1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.529498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.541697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:00.568784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6e3dbcfd-4471-4de0-a8ae-fe082e46e1ee None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:00.570339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6e3dbcfd-4471-4de0-a8ae-fe082e46e1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:00.571850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2794e8-785a-445d-baa5-0260f112677b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.675523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 854/1721] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:00.686440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dbcfd-4471-4de0-a8ae-fe082e46e1ee None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.690824 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6e3dbcfd-4471-4de0-a8ae-fe082e46e1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:00.721357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b0d4-1c82-4559-a5c8-f0fad3e70dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.722794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b0d4-1c82-4559-a5c8-f0fad3e70dbe admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.724100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b0d4-1c82-4559-a5c8-f0fad3e70dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.724767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108b0d4-1c82-4559-a5c8-f0fad3e70dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.726077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108b0d4-1c82-4559-a5c8-f0fad3e70dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.728301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b108b0d4-1c82-4559-a5c8-f0fad3e70dbe admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.750097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 868/1722] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:00.751231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b0d4-1c82-4559-a5c8-f0fad3e70dbe admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:00.764166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108b0d4-1c82-4559-a5c8-f0fad3e70dbe admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.769399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16405c18-6a48-4c88-9fb3-404cc36140da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.770709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16405c18-6a48-4c88-9fb3-404cc36140da admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.780521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16405c18-6a48-4c88-9fb3-404cc36140da admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.780521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16405c18-6a48-4c88-9fb3-404cc36140da admin admin] PATH_INFO: `/v3/projects/8ca1a6641a164a51b7a3ee857f21bdb4/users/5a39cc0b714748d5a38c44f3178e22e2/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.780753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dbcfd-4471-4de0-a8ae-fe082e46e1ee None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:00.780753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf39c13-238c-43f3-ab9a-9e7a7e73d584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:00.780753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf39c13-238c-43f3-ab9a-9e7a7e73d584 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.780753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf39c13-238c-43f3-ab9a-9e7a7e73d584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.781085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf39c13-238c-43f3-ab9a-9e7a7e73d584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.789518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16405c18-6a48-4c88-9fb3-404cc36140da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ca1a6641a164a51b7a3ee857f21bdb4, user_id=5a39cc0b714748d5a38c44f3178e22e2, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.792954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16405c18-6a48-4c88-9fb3-404cc36140da admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.800990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf39c13-238c-43f3-ab9a-9e7a7e73d584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:00.803860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf39c13-238c-43f3-ab9a-9e7a7e73d584 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:00.815493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 855/1723] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:00.893878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 869/1724] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:00 2022] PUT /identity/v3/projects/8ca1a6641a164a51b7a3ee857f21bdb4/users/5a39cc0b714748d5a38c44f3178e22e2/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:00.906119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509caa6d-c881-4eb4-ad2a-cc23de1bc43c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:00.907206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509caa6d-c881-4eb4-ad2a-cc23de1bc43c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:00.907630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509caa6d-c881-4eb4-ad2a-cc23de1bc43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:00.972709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-509caa6d-c881-4eb4-ad2a-cc23de1bc43c None None] MFA Rules not processed for user `5a39cc0b714748d5a38c44f3178e22e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:00.983712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-509caa6d-c881-4eb4-ad2a-cc23de1bc43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:01.054510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab21d8-3764-40c7-b71a-d9dea654977e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:01.062113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab21d8-3764-40c7-b71a-d9dea654977e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:01.062113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ab21d8-3764-40c7-b71a-d9dea654977e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:01.074156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 856/1725] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:01.084061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509caa6d-c881-4eb4-ad2a-cc23de1bc43c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:01.085134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-76ab21d8-3764-40c7-b71a-d9dea654977e None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:01.086361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-76ab21d8-3764-40c7-b71a-d9dea654977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:01.091314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-509caa6d-c881-4eb4-ad2a-cc23de1bc43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:01.197266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 870/1726] 10.222.0.15 () {58 vars in 1015 bytes} [Thu May 26 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:01.219551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509caa6d-c881-4eb4-ad2a-cc23de1bc43c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:01.225093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab21d8-3764-40c7-b71a-d9dea654977e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:01.227742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-76ab21d8-3764-40c7-b71a-d9dea654977e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:01.237328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:01.238014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:01.238296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:01.238680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:01.251326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:01.254175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:01.275409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 857/1727] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:01.291134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ab21d8-3764-40c7-b71a-d9dea654977e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:01.291664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:01.298348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:01.338071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:01.338071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:01.338071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:01.338071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:01.361185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:01.362861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:01.397537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 871/1728] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:01.412463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae360ce7-fde1-4345-8e5b-e9b3e96e9625 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:01.418542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:01.419445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:01.419726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:01.420000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] PATH_INFO: `/v3/projects/a7958c6fca6045d78d9d0fb72d70621d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:01.421895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7958c6fca6045d78d9d0fb72d70621d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:01.424083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:01.576507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:01.578281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:01.603564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7958c6fca6045d78d9d0fb72d70621d', 'request_id': 'req-5c57a1af-eb03-4a39-91e2-b1c932412a5d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:01.603679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9608c-7f84-43c5-bb0a-f57e91613538 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:01.606911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7958c6fca6045d78d9d0fb72d70621d', 'request_id': 'req-5c57a1af-eb03-4a39-91e2-b1c932412a5d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:01.619224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7958c6fca6045d78d9d0fb72d70621d', 'request_id': 'req-5c57a1af-eb03-4a39-91e2-b1c932412a5d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:01.669798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:01.670618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:01.670898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:01.671171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] PATH_INFO: `/v3/projects/20667d6f11634df7a04808743d9dde8f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:01.672417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20667d6f11634df7a04808743d9dde8f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:01.675052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:01.756334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] The token cache is being invalidate because project a7958c6fca6045d78d9d0fb72d70621d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:01.757862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:01.757862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c57a1af-eb03-4a39-91e2-b1c932412a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:01.760160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 858/1729] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:01 2022] DELETE /identity/v3/projects/a7958c6fca6045d78d9d0fb72d70621d => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:01.765751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600118c2-c101-4b2b-b97c-0802b9ae238e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:01.766114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600118c2-c101-4b2b-b97c-0802b9ae238e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:01.766460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600118c2-c101-4b2b-b97c-0802b9ae238e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:01.788363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-600118c2-c101-4b2b-b97c-0802b9ae238e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:01.789748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-600118c2-c101-4b2b-b97c-0802b9ae238e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:01.799018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 859/1730] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:01.807873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5702cf-d860-4446-bef4-ee1f21804ae7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:01.808175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5702cf-d860-4446-bef4-ee1f21804ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:01.808565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5702cf-d860-4446-bef4-ee1f21804ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:01.828535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3e5702cf-d860-4446-bef4-ee1f21804ae7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:01.829762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3e5702cf-d860-4446-bef4-ee1f21804ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:01.838088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 860/1731] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:01.842313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5702cf-d860-4446-bef4-ee1f21804ae7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:01.863316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5702cf-d860-4446-bef4-ee1f21804ae7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:01.877024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20667d6f11634df7a04808743d9dde8f', 'request_id': 'req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:01.894998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20667d6f11634df7a04808743d9dde8f', 'request_id': 'req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:01.963771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:01.964541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:01.993035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:01.993035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:01.993035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:01.993035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:01.993035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:01.993035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 861/1732] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:48:01.994000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:01.997486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ec733-beaa-48a9-833c-1dc17817595e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.002630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.003310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.003598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.003877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.004610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.007224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.058941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20667d6f11634df7a04808743d9dde8f', 'request_id': 'req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:02.078947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] The token cache is being invalidate because project 20667d6f11634df7a04808743d9dde8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:02.079235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:02.080135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5afc7b04-ef70-4b8a-83b9-0cc25fded99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:02.081720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 872/1733] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:01 2022] DELETE /identity/v3/projects/20667d6f11634df7a04808743d9dde8f => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:02.086844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f569-9363-4fdc-813b-1867ff118bbc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.087128 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f569-9363-4fdc-813b-1867ff118bbc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.087403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2f569-9363-4fdc-813b-1867ff118bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.109973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-38b2f569-9363-4fdc-813b-1867ff118bbc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:02.111245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-38b2f569-9363-4fdc-813b-1867ff118bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:02.127313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 873/1734] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:02.136503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a653-c6a6-44ea-ad4e-9b6f9deb6be4 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.136856 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a653-c6a6-44ea-ad4e-9b6f9deb6be4 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.137244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a653-c6a6-44ea-ad4e-9b6f9deb6be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.151772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 862/1735] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:01 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:02.156529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-fc86a653-c6a6-44ea-ad4e-9b6f9deb6be4 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:02.157767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fc86a653-c6a6-44ea-ad4e-9b6f9deb6be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:02.158152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.159943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:02.226398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 874/1736] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:02.230864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86a653-c6a6-44ea-ad4e-9b6f9deb6be4 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.234851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ceac4-e568-428f-b811-3404e4f105c9 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.253257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86a653-c6a6-44ea-ad4e-9b6f9deb6be4 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.253257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.253508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd981-d8c1-4b31-988f-3e883cb9beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.253603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.253603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.253732 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd981-d8c1-4b31-988f-3e883cb9beea admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.253805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.253886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd981-d8c1-4b31-988f-3e883cb9beea admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.253953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:02.253953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.254102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0fd981-d8c1-4b31-988f-3e883cb9beea admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.254102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fd981-d8c1-4b31-988f-3e883cb9beea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.254244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.254317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0fd981-d8c1-4b31-988f-3e883cb9beea admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.276033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 875/1737] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:48:02.282315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.305482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d829f-67a5-4c1b-af72-3761ddf7259b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.311212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab4d72-26c3-440f-bff6-3aca3a27a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.312508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab4d72-26c3-440f-bff6-3aca3a27a9ba admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.312943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab4d72-26c3-440f-bff6-3aca3a27a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.313316 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab4d72-26c3-440f-bff6-3aca3a27a9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.314127 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab4d72-26c3-440f-bff6-3aca3a27a9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.316188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ab4d72-26c3-440f-bff6-3aca3a27a9ba admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.436437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 863/1738] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:02 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:02.440643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd981-d8c1-4b31-988f-3e883cb9beea admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.451917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0fd981-d8c1-4b31-988f-3e883cb9beea admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.456945 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee77f-f703-4593-8292-ae70e17e99dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.457634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee77f-f703-4593-8292-ae70e17e99dd admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.457957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee77f-f703-4593-8292-ae70e17e99dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.458452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ee77f-f703-4593-8292-ae70e17e99dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.459306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ee77f-f703-4593-8292-ae70e17e99dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.461737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ee77f-f703-4593-8292-ae70e17e99dd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.472345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 864/1739] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:02.476577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee77f-f703-4593-8292-ae70e17e99dd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.486665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ee77f-f703-4593-8292-ae70e17e99dd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.492460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bccd0-9777-4863-b43c-75ed5b69647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.493135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bccd0-9777-4863-b43c-75ed5b69647e admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.498614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bccd0-9777-4863-b43c-75ed5b69647e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.498614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7bccd0-9777-4863-b43c-75ed5b69647e admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.498614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bccd0-9777-4863-b43c-75ed5b69647e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.498614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7bccd0-9777-4863-b43c-75ed5b69647e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.507123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 865/1740] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:02.511768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bccd0-9777-4863-b43c-75ed5b69647e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.521909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7bccd0-9777-4863-b43c-75ed5b69647e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.526638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb18a2-ec1e-4809-b8a6-f76c6cd39793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.527520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb18a2-ec1e-4809-b8a6-f76c6cd39793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.527796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb18a2-ec1e-4809-b8a6-f76c6cd39793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.528067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb18a2-ec1e-4809-b8a6-f76c6cd39793 admin admin] PATH_INFO: `/v3/projects/dea7eaa497294732a678ae3148d6e234/users/a78b2ac393384bceb74b9418d784ff0d/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.544108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb18a2-ec1e-4809-b8a6-f76c6cd39793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea7eaa497294732a678ae3148d6e234, user_id=a78b2ac393384bceb74b9418d784ff0d, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.546771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb18a2-ec1e-4809-b8a6-f76c6cd39793 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.556933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:02.566676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 876/1741] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:02 2022] POST /identity/v3/projects => generated 405 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:02.571777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab4d72-26c3-440f-bff6-3aca3a27a9ba admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.655062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab4d72-26c3-440f-bff6-3aca3a27a9ba admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.659910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c798e47-340a-4661-a9c5-baab797524f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.660891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798e47-340a-4661-a9c5-baab797524f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.661603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798e47-340a-4661-a9c5-baab797524f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.661884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c798e47-340a-4661-a9c5-baab797524f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.662653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c798e47-340a-4661-a9c5-baab797524f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.664837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c798e47-340a-4661-a9c5-baab797524f7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.795609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 866/1742] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:02 2022] PUT /identity/v3/projects/dea7eaa497294732a678ae3148d6e234/users/a78b2ac393384bceb74b9418d784ff0d/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:02.807601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bc114-c3b7-4646-bbf1-c6d955f4060c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.807886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bc114-c3b7-4646-bbf1-c6d955f4060c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.808161 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bc114-c3b7-4646-bbf1-c6d955f4060c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.834520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 877/1743] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:02 2022] POST /identity/v3/users => generated 303 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:02.840447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c798e47-340a-4661-a9c5-baab797524f7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.855059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c798e47-340a-4661-a9c5-baab797524f7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.867986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4b2bc114-c3b7-4646-bbf1-c6d955f4060c None None] MFA Rules not processed for user `a78b2ac393384bceb74b9418d784ff0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:02.877479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4b2bc114-c3b7-4646-bbf1-c6d955f4060c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:02.946485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78923662-6a9a-409a-b199-befa5e6e9f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.947345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923662-6a9a-409a-b199-befa5e6e9f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.947748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923662-6a9a-409a-b199-befa5e6e9f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.948120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78923662-6a9a-409a-b199-befa5e6e9f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.948953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78923662-6a9a-409a-b199-befa5e6e9f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.949752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 867/1744] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:02.952255 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873caf67-542f-4a6b-b5ce-9c190c0a23c1 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.952944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873caf67-542f-4a6b-b5ce-9c190c0a23c1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.953444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873caf67-542f-4a6b-b5ce-9c190c0a23c1 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.954654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78923662-6a9a-409a-b199-befa5e6e9f38 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.955731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 868/1745] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:48:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:48:02.956736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873caf67-542f-4a6b-b5ce-9c190c0a23c1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:02.967767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 878/1746] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:02 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:02.969395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b7f59-c307-43ab-9ed2-bf14e22569fa None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.969646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b7f59-c307-43ab-9ed2-bf14e22569fa None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.970015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b7f59-c307-43ab-9ed2-bf14e22569fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.983017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873caf67-542f-4a6b-b5ce-9c190c0a23c1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:02.988009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790fc2-914b-42cb-a8df-f7826f93862e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:02.988647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790fc2-914b-42cb-a8df-f7826f93862e admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:02.988932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790fc2-914b-42cb-a8df-f7826f93862e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:02.990606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790fc2-914b-42cb-a8df-f7826f93862e admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:02.991753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c790fc2-914b-42cb-a8df-f7826f93862e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:02.994661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-bf4b7f59-c307-43ab-9ed2-bf14e22569fa None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:02.995394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c790fc2-914b-42cb-a8df-f7826f93862e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:02.996831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bf4b7f59-c307-43ab-9ed2-bf14e22569fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:03.106579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 879/1747] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:03.107668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b7f59-c307-43ab-9ed2-bf14e22569fa None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.120800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b7f59-c307-43ab-9ed2-bf14e22569fa None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.127449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.128128 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.128406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.128705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.129459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.131348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:03.144017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 880/1748] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:03.144731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.148084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:03.168221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 869/1749] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:02 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:03.168221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790fc2-914b-42cb-a8df-f7826f93862e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.175692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31bec8-8f15-4648-af27-11263723e4df admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.245161 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790fc2-914b-42cb-a8df-f7826f93862e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.251909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.253136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.253526 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.253744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] PATH_INFO: `/v3/projects/db919d4517f749df8f52e102babab0e2/users/f5f19286322e405daf6ab54108a7dc8d/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.274562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140de3-ec79-46a7-9a22-84b15e3c53ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.275133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db919d4517f749df8f52e102babab0e2, user_id=f5f19286322e405daf6ab54108a7dc8d, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.281264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140de3-ec79-46a7-9a22-84b15e3c53ea service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.281264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140de3-ec79-46a7-9a22-84b15e3c53ea service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.281264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa140de3-ec79-46a7-9a22-84b15e3c53ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.281649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:03.287728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa140de3-ec79-46a7-9a22-84b15e3c53ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.289339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa140de3-ec79-46a7-9a22-84b15e3c53ea service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:03.300192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 881/1750] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:03.300969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140de3-ec79-46a7-9a22-84b15e3c53ea service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.311558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa140de3-ec79-46a7-9a22-84b15e3c53ea service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.316117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf8459-7990-4cd6-9454-5b55518698f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.316791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8459-7990-4cd6-9454-5b55518698f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.317070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8459-7990-4cd6-9454-5b55518698f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.317458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf8459-7990-4cd6-9454-5b55518698f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.318936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf8459-7990-4cd6-9454-5b55518698f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.320919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf8459-7990-4cd6-9454-5b55518698f6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:03.463992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 870/1751] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:03 2022] PUT /identity/v3/projects/db919d4517f749df8f52e102babab0e2/users/f5f19286322e405daf6ab54108a7dc8d/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:03.464852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.472347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:03.508224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 882/1752] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:03 2022] POST /identity/v3/users => generated 289 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:03.508224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dc7b7-fca9-4032-99ad-a0033ceaf672 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.508224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dc7b7-fca9-4032-99ad-a0033ceaf672 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.508224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0dc7b7-fca9-4032-99ad-a0033ceaf672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.536427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-6d0dc7b7-fca9-4032-99ad-a0033ceaf672 None None] MFA Rules not processed for user `f5f19286322e405daf6ab54108a7dc8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:03.537747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6d0dc7b7-fca9-4032-99ad-a0033ceaf672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:03.540834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3485fad1-0485-4eb6-ba8d-fafb6613fc53 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.545486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.546370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.546774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.547057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] PATH_INFO: `/v3/users/2bfba39fa804430d83ff85f84dddf70d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.548275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bfba39fa804430d83ff85f84dddf70d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.550187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:03.611933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 883/1753] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:03.613063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dc7b7-fca9-4032-99ad-a0033ceaf672 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.625045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0dc7b7-fca9-4032-99ad-a0033ceaf672 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.629689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb570b-9180-470b-a212-b0785a190162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.631021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb570b-9180-470b-a212-b0785a190162 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.631349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb570b-9180-470b-a212-b0785a190162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.631622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb570b-9180-470b-a212-b0785a190162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.632340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb570b-9180-470b-a212-b0785a190162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.633951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb570b-9180-470b-a212-b0785a190162 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:03.644478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 884/1754] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:03.645238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb570b-9180-470b-a212-b0785a190162 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.661082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb570b-9180-470b-a212-b0785a190162 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.666847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ffbd2-78e2-449e-9a8d-48d74b662046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.667649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffbd2-78e2-449e-9a8d-48d74b662046 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.667986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffbd2-78e2-449e-9a8d-48d74b662046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.668919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ffbd2-78e2-449e-9a8d-48d74b662046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.669622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ffbd2-78e2-449e-9a8d-48d74b662046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.672271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ffbd2-78e2-449e-9a8d-48d74b662046 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:03.815608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 885/1755] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:03 2022] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:03.815608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ffbd2-78e2-449e-9a8d-48d74b662046 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.868904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bfba39fa804430d83ff85f84dddf70d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:03.869806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bfba39fa804430d83ff85f84dddf70d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:03.870927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bfba39fa804430d83ff85f84dddf70d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:03.885717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ffbd2-78e2-449e-9a8d-48d74b662046 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.887073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bfba39fa804430d83ff85f84dddf70d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:03.891065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.891783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.892061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.892332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.893088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.894688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:03.896864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bfba39fa804430d83ff85f84dddf70d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:03.910085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 886/1756] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:03.910085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:03.912257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:03.927209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7796d37c-e08c-417c-bc41-db479ecae1bc admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:03.937224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e01ebe-4aac-42dc-aa17-f20604b3f878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:03.937924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e01ebe-4aac-42dc-aa17-f20604b3f878 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:03.938202 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e01ebe-4aac-42dc-aa17-f20604b3f878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:03.938475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e01ebe-4aac-42dc-aa17-f20604b3f878 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:03.939516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e01ebe-4aac-42dc-aa17-f20604b3f878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:03.941994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e01ebe-4aac-42dc-aa17-f20604b3f878 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.009528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 871/1757] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:03 2022] DELETE /identity/v3/users/2bfba39fa804430d83ff85f84dddf70d => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:04.010983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.012692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:04.058513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 887/1758] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:03 2022] POST /identity/v3/users => generated 307 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:04.059818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69afc-d614-4409-a42f-20c392bfbf27 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.060425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69afc-d614-4409-a42f-20c392bfbf27 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.060425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f69afc-d614-4409-a42f-20c392bfbf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.107139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-66f69afc-d614-4409-a42f-20c392bfbf27 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:04.110613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-66f69afc-d614-4409-a42f-20c392bfbf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:04.145086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5f2bc-6fcf-4e71-be1f-8edc206393cc admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.149118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 888/1759] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:04.153294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f69afc-d614-4409-a42f-20c392bfbf27 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.156450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b51c0-17a4-4fd0-b38b-578af6dc2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.159094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b51c0-17a4-4fd0-b38b-578af6dc2cd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.160043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b51c0-17a4-4fd0-b38b-578af6dc2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.163347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b51c0-17a4-4fd0-b38b-578af6dc2cd0 admin admin] PATH_INFO: `/v3/projects/a66bb17f199c4e8a97d6fa1cd195721c/users/af7416a79d884a7e86a24c4503a33d33/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.190321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f69afc-d614-4409-a42f-20c392bfbf27 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.194719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b51c0-17a4-4fd0-b38b-578af6dc2cd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66bb17f199c4e8a97d6fa1cd195721c, user_id=af7416a79d884a7e86a24c4503a33d33, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.208273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b51c0-17a4-4fd0-b38b-578af6dc2cd0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.225953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.226918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.227343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.228482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.230456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.237888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.272570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 889/1760] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:04.273626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.282784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:04.344892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 872/1761] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:04 2022] PUT /identity/v3/projects/a66bb17f199c4e8a97d6fa1cd195721c/users/af7416a79d884a7e86a24c4503a33d33/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:04.346229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b51c0-17a4-4fd0-b38b-578af6dc2cd0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.358554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe001ef-9c5e-4d3e-94ec-9817cbc1a860 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.451484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.452185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.452464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.453014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.477031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b51c0-17a4-4fd0-b38b-578af6dc2cd0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.477031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873d6fd-e43d-4497-93c6-912a18ee9ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.477031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d6fd-e43d-4497-93c6-912a18ee9ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.477031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d6fd-e43d-4497-93c6-912a18ee9ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.477540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873d6fd-e43d-4497-93c6-912a18ee9ebf admin admin] PATH_INFO: `/v3/projects/eb575ac72ded4a7cbf25d148f6f34b4c/users/9ebc85c13a064ec7b7f60fa9aa13eac4/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.478378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.480079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.490149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873d6fd-e43d-4497-93c6-912a18ee9ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb575ac72ded4a7cbf25d148f6f34b4c, user_id=9ebc85c13a064ec7b7f60fa9aa13eac4, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.493061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873d6fd-e43d-4497-93c6-912a18ee9ebf admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.497505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 890/1762] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:04.498633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.500137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:04.521485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd5cd-8824-428b-b327-3ce153e626f7 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.524494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.525460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.525806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.526340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] PATH_INFO: `/v3/users/a3b882edba144c64be08837223910f28` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.527723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b882edba144c64be08837223910f28)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.529718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.682098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 873/1763] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:04 2022] PUT /identity/v3/projects/eb575ac72ded4a7cbf25d148f6f34b4c/users/9ebc85c13a064ec7b7f60fa9aa13eac4/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:04.691576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed3641-d1f9-46f7-87ad-25da2d46304d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.691576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed3641-d1f9-46f7-87ad-25da2d46304d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.691576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed3641-d1f9-46f7-87ad-25da2d46304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.713562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d3ed3641-d1f9-46f7-87ad-25da2d46304d None None] MFA Rules not processed for user `af7416a79d884a7e86a24c4503a33d33`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:04.714855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d3ed3641-d1f9-46f7-87ad-25da2d46304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:04.788785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 874/1764] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:04.789603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed3641-d1f9-46f7-87ad-25da2d46304d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.866206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed3641-d1f9-46f7-87ad-25da2d46304d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.876511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23495b6c-ecb0-478e-bb8a-becae937f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.877423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23495b6c-ecb0-478e-bb8a-becae937f843 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.877856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23495b6c-ecb0-478e-bb8a-becae937f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.878653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23495b6c-ecb0-478e-bb8a-becae937f843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.879459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23495b6c-ecb0-478e-bb8a-becae937f843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.882286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23495b6c-ecb0-478e-bb8a-becae937f843 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.898960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 875/1765] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:04.900531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23495b6c-ecb0-478e-bb8a-becae937f843 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:04.910878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23495b6c-ecb0-478e-bb8a-becae937f843 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:04.916688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:04.917451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:04.917731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:04.918001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:04.918725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:04.920655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:04.975780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b882edba144c64be08837223910f28'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:04.976573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b882edba144c64be08837223910f28'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:04.985443 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b882edba144c64be08837223910f28'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:05.000621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b882edba144c64be08837223910f28'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:05.001444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b882edba144c64be08837223910f28'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:05.108877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 876/1766] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:04 2022] POST /identity/v3/projects => generated 377 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:05.109607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:05.112651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.169961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 891/1767] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:04 2022] DELETE /identity/v3/users/a3b882edba144c64be08837223910f28 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:05.169961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:05.169961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.209080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62cfe01-9349-4335-8f36-c5e4e0fbce95 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:05.256904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5198ef23-981b-4520-8433-ccb2576a9a60 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:05.264367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:05.266769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.266769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.266769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.266769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:05.270583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:05.286547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386db7c0-035a-429a-ab3c-cf27395b3ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:05.287877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db7c0-035a-429a-ab3c-cf27395b3ead admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.288566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db7c0-035a-429a-ab3c-cf27395b3ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.288948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386db7c0-035a-429a-ab3c-cf27395b3ead admin admin] PATH_INFO: `/v3/projects/eb575ac72ded4a7cbf25d148f6f34b4c/users/9ebc85c13a064ec7b7f60fa9aa13eac4/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.294576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386db7c0-035a-429a-ab3c-cf27395b3ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb575ac72ded4a7cbf25d148f6f34b4c, user_id=9ebc85c13a064ec7b7f60fa9aa13eac4, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:05.298400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386db7c0-035a-429a-ab3c-cf27395b3ead admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:05.318803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 877/1768] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:05 2022] PUT /identity/v3/projects/eb575ac72ded4a7cbf25d148f6f34b4c/users/9ebc85c13a064ec7b7f60fa9aa13eac4/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:05.321145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ff32-1f5e-4383-8edc-15dc8727c773 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.321596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ff32-1f5e-4383-8edc-15dc8727c773 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.322020 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b9ff32-1f5e-4383-8edc-15dc8727c773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.352169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-95b9ff32-1f5e-4383-8edc-15dc8727c773 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:05.354412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-95b9ff32-1f5e-4383-8edc-15dc8727c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.450404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 878/1769] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:05.452511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e49dd-ec2a-4d86-a207-38fdd475b04a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.452804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e49dd-ec2a-4d86-a207-38fdd475b04a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.453080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e49dd-ec2a-4d86-a207-38fdd475b04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.497887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:05.501924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f10e49dd-ec2a-4d86-a207-38fdd475b04a None None] MFA Rules not processed for user `9ebc85c13a064ec7b7f60fa9aa13eac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:05.503238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f10e49dd-ec2a-4d86-a207-38fdd475b04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.508372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 892/1770] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:05 2022] POST /identity/v3/users => generated 295 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:05.522359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:05.528655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.595860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 879/1771] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:05.595860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e49dd-ec2a-4d86-a207-38fdd475b04a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:05.617617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e49dd-ec2a-4d86-a207-38fdd475b04a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:05.623761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:05.624453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.624741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.625048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.625860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:05.627654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:05.644142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 880/1772] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:05.645113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:05.647902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.719161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306135b6-677d-4adf-a6d0-f8daddf5efba admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:05.784117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da93c970-16c9-4257-84c9-3a854a74db1c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:05.791281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:05.792128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.792586 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.793006 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.812659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a38323-fc5c-4a7d-97f2-9df8de417a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:05.813517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a38323-fc5c-4a7d-97f2-9df8de417a87 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.813914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a38323-fc5c-4a7d-97f2-9df8de417a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.815915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a38323-fc5c-4a7d-97f2-9df8de417a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.819757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:05.821545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:05.829892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a38323-fc5c-4a7d-97f2-9df8de417a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:05.832108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a38323-fc5c-4a7d-97f2-9df8de417a87 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:05.837228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 881/1773] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:05 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:05.839720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:05.841614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:05.852355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 893/1774] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:05.852355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a38323-fc5c-4a7d-97f2-9df8de417a87 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:05.860738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84122cb-bc06-4edb-a07f-69aa2bcbf3b3 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:05.864072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a38323-fc5c-4a7d-97f2-9df8de417a87 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:05.871420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:05.872472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.872607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.872845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] PATH_INFO: `/v3/projects/f5bba01dc02d413389109b932148e716` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:05.874774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5bba01dc02d413389109b932148e716)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:05.876695 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:05.928134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db13f5-8ecc-4b34-a62e-4b475a5bc8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:05.939246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db13f5-8ecc-4b34-a62e-4b475a5bc8e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:05.939246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db13f5-8ecc-4b34-a62e-4b475a5bc8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:05.939554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db13f5-8ecc-4b34-a62e-4b475a5bc8e1 admin admin] PATH_INFO: `/v3/projects/e9414e3fb27e449683d3849cec706fb7/users/8275bb1dd2fa40b18826b1537f80429d/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:06.028990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db13f5-8ecc-4b34-a62e-4b475a5bc8e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9414e3fb27e449683d3849cec706fb7, user_id=8275bb1dd2fa40b18826b1537f80429d, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:06.028990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db13f5-8ecc-4b34-a62e-4b475a5bc8e1 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:06.226421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 894/1775] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:05 2022] PUT /identity/v3/projects/e9414e3fb27e449683d3849cec706fb7/users/8275bb1dd2fa40b18826b1537f80429d/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:06.227716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db13f5-8ecc-4b34-a62e-4b475a5bc8e1 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:06.239973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5bba01dc02d413389109b932148e716', 'request_id': 'req-ae999be7-47af-4f56-acc5-9972d8241db0'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.255645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5bba01dc02d413389109b932148e716', 'request_id': 'req-ae999be7-47af-4f56-acc5-9972d8241db0'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.268119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5bba01dc02d413389109b932148e716', 'request_id': 'req-ae999be7-47af-4f56-acc5-9972d8241db0'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.327288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db13f5-8ecc-4b34-a62e-4b475a5bc8e1 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:06.426461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:06.427471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:06.427749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:06.429043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] PATH_INFO: `/v3/users/f5f19286322e405daf6ab54108a7dc8d` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:06.429969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f19286322e405daf6ab54108a7dc8d)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:06.432664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:06.490574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] The token cache is being invalidate because project f5bba01dc02d413389109b932148e716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:06.491102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.492075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.497826 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 882/1776] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:05 2022] DELETE /identity/v3/projects/f5bba01dc02d413389109b932148e716 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:06.498613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:06.499770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:06.515702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae999be7-47af-4f56-acc5-9972d8241db0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:06.521484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:06.522496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:06.523022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:06.523501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] PATH_INFO: `/v3/users/5a39cc0b714748d5a38c44f3178e22e2` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:06.524930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a39cc0b714748d5a38c44f3178e22e2)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:06.527141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:06.711853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f19286322e405daf6ab54108a7dc8d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.712553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f19286322e405daf6ab54108a7dc8d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.721433 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f19286322e405daf6ab54108a7dc8d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.740083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f19286322e405daf6ab54108a7dc8d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.741117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f19286322e405daf6ab54108a7dc8d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.820697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a39cc0b714748d5a38c44f3178e22e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.821407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a39cc0b714748d5a38c44f3178e22e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.822305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a39cc0b714748d5a38c44f3178e22e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.835700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a39cc0b714748d5a38c44f3178e22e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.843209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bf78834-9bf3-4fee-a6b1-08b1a82e4f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a39cc0b714748d5a38c44f3178e22e2'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:06.846153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 895/1777] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:06 2022] DELETE /identity/v3/users/f5f19286322e405daf6ab54108a7dc8d => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:06.847324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:06.848872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:06.923297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6318c441-a08d-4dbc-a1c7-fa451632d9ba admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:06.930258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:06.931035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:06.931332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:06.931821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:06.932562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:06.935334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:06.951413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 896/1778] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:06 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:06.953319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:06.965512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 883/1779] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:06 2022] DELETE /identity/v3/users/5a39cc0b714748d5a38c44f3178e22e2 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:06.966934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0618-af90-42ef-a703-4b4ae267024b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:06.967219 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0618-af90-42ef-a703-4b4ae267024b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:06.967494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a0618-af90-42ef-a703-4b4ae267024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:06.968718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:06.990868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd5ed4-03f4-4cec-b582-61b43cc31d1c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:06.999091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-354a0618-af90-42ef-a703-4b4ae267024b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:07.000672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-354a0618-af90-42ef-a703-4b4ae267024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:07.110143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 884/1780] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:07.110143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a0618-af90-42ef-a703-4b4ae267024b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:07.111611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-354a0618-af90-42ef-a703-4b4ae267024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:07.124150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:07.125328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.126210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.126868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] PATH_INFO: `/v3/users/b314cf4877cd48c4a06bf67c03b7f930` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.128809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b314cf4877cd48c4a06bf67c03b7f930)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:07.132574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:07.148071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a0618-af90-42ef-a703-4b4ae267024b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:07.153387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:07.154449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.155009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.155390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] PATH_INFO: `/v3/projects/7305192f53864869903074b061fc0e40` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.158056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7305192f53864869903074b061fc0e40)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:07.162424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:07.477472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7305192f53864869903074b061fc0e40', 'request_id': 'req-c6b4c885-af1c-4c69-9bfa-c4b216e73998'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.485492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7305192f53864869903074b061fc0e40', 'request_id': 'req-c6b4c885-af1c-4c69-9bfa-c4b216e73998'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.492377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7305192f53864869903074b061fc0e40', 'request_id': 'req-c6b4c885-af1c-4c69-9bfa-c4b216e73998'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.493048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b314cf4877cd48c4a06bf67c03b7f930'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.493815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b314cf4877cd48c4a06bf67c03b7f930'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.502165 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b314cf4877cd48c4a06bf67c03b7f930'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.524926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b314cf4877cd48c4a06bf67c03b7f930'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.526002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-d3145058-f281-45c0-b48b-ede9db283cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b314cf4877cd48c4a06bf67c03b7f930'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.595422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] The token cache is being invalidate because project 7305192f53864869903074b061fc0e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:07.595818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.597165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:07.599541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 885/1781] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:07 2022] DELETE /identity/v3/projects/7305192f53864869903074b061fc0e40 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:07.600524 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:07.602000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:07.683706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b4c885-af1c-4c69-9bfa-c4b216e73998 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:07.688558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:07.689467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.689750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.690069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] PATH_INFO: `/v3/projects/e9414e3fb27e449683d3849cec706fb7/users/8275bb1dd2fa40b18826b1537f80429d/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.690996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 897/1782] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:06 2022] DELETE /identity/v3/users/b314cf4877cd48c4a06bf67c03b7f930 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:07.696222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b21c-7d72-49e3-b843-40224d22b349 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.696222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b21c-7d72-49e3-b843-40224d22b349 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.696222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90b21c-7d72-49e3-b843-40224d22b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.696854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9414e3fb27e449683d3849cec706fb7, user_id=8275bb1dd2fa40b18826b1537f80429d, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:07.698434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:07.719633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 886/1783] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:07 2022] PUT /identity/v3/projects/e9414e3fb27e449683d3849cec706fb7/users/8275bb1dd2fa40b18826b1537f80429d/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:07.719633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:07.719633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:07.736301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-da90b21c-7d72-49e3-b843-40224d22b349 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:07.740374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-da90b21c-7d72-49e3-b843-40224d22b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:07.783129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebaf9e-5b71-4957-be7c-afb4c0899da9 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:07.790506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c46eec-aa3e-491a-bfd0-fc5b1dfd958b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:07.791232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46eec-aa3e-491a-bfd0-fc5b1dfd958b service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.791512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46eec-aa3e-491a-bfd0-fc5b1dfd958b service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.791790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c46eec-aa3e-491a-bfd0-fc5b1dfd958b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.794547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-95c46eec-aa3e-491a-bfd0-fc5b1dfd958b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:07.842045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 898/1784] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:07.842045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b21c-7d72-49e3-b843-40224d22b349 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:07.844399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-da90b21c-7d72-49e3-b843-40224d22b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:07.848523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:07.898142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c46eec-aa3e-491a-bfd0-fc5b1dfd958b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:07.903277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c46eec-aa3e-491a-bfd0-fc5b1dfd958b service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:07.903469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90b21c-7d72-49e3-b843-40224d22b349 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:07.912026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 887/1785] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:07.915969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5832-af7f-4212-9ba8-f0d13e90d0cf None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.915969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5832-af7f-4212-9ba8-f0d13e90d0cf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.915969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd5832-af7f-4212-9ba8-f0d13e90d0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.917865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:07.918811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:07.919083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:07.919350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] PATH_INFO: `/v3/users/b01f6fb342804e4a967058491f2d6a44` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:07.931997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b01f6fb342804e4a967058491f2d6a44)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:07.935290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:07.994728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bbdd5832-af7f-4212-9ba8-f0d13e90d0cf None None] MFA Rules not processed for user `8275bb1dd2fa40b18826b1537f80429d`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:07.994728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bbdd5832-af7f-4212-9ba8-f0d13e90d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.115729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 888/1786] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:08.116638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd5832-af7f-4212-9ba8-f0d13e90d0cf None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:08.118559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bbdd5832-af7f-4212-9ba8-f0d13e90d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.138565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd5832-af7f-4212-9ba8-f0d13e90d0cf None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:08.147853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54071ed-a082-4686-87da-33aacb15500d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:08.149139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54071ed-a082-4686-87da-33aacb15500d service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.149445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54071ed-a082-4686-87da-33aacb15500d service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.150134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54071ed-a082-4686-87da-33aacb15500d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.181584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54071ed-a082-4686-87da-33aacb15500d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:08.182489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b01f6fb342804e4a967058491f2d6a44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.183293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b01f6fb342804e4a967058491f2d6a44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.185040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54071ed-a082-4686-87da-33aacb15500d service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:08.196216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b01f6fb342804e4a967058491f2d6a44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.207103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 889/1787] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:08.209557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f036c-a127-4151-ac22-1a4cac7a446d None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.221111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f036c-a127-4151-ac22-1a4cac7a446d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.221111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f036c-a127-4151-ac22-1a4cac7a446d None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.221111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 890/1788] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:48:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:48:08.221447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b01f6fb342804e4a967058491f2d6a44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.221523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f036c-a127-4151-ac22-1a4cac7a446d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:08.221603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b2ae3232-0d00-40d2-a6d3-e67456b84e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b01f6fb342804e4a967058491f2d6a44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:08.221672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a66f036c-a127-4151-ac22-1a4cac7a446d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.304225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f036c-a127-4151-ac22-1a4cac7a446d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:08.308572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:08.309428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.309850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.312801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.312801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.313351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 899/1789] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:07 2022] DELETE /identity/v3/users/b01f6fb342804e4a967058491f2d6a44 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:08.315530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0d97-8bb8-4845-8a3c-285bd5fbe0d2 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.315967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0d97-8bb8-4845-8a3c-285bd5fbe0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.316411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d0d97-8bb8-4845-8a3c-285bd5fbe0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.328586 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:08.330103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:08.343410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 891/1790] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:08.351217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-551d0d97-8bb8-4845-8a3c-285bd5fbe0d2 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:08.352682 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-551d0d97-8bb8-4845-8a3c-285bd5fbe0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.481654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 900/1791] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:48:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:08.493184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:08.496737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.499504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d0d97-8bb8-4845-8a3c-285bd5fbe0d2 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:08.502215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-551d0d97-8bb8-4845-8a3c-285bd5fbe0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.592547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d0d97-8bb8-4845-8a3c-285bd5fbe0d2 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:08.596502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:08.597229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.597517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.597785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.602379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.626986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9b454-6ce3-4b7a-8db9-611ddcbcb856 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:08.642991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:08.645133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.645544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.646345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.660319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:08.664287 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:08.681600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 892/1792] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:08.682996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:08.683412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:08.685009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.685133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:08.708467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 901/1793] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:08.800178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf410bf-5d20-43c4-b6f9-d6df0d32a348 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:08.806847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:08.807625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.808003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.808789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] PATH_INFO: `/v3/projects/a264293ce21d4f4bbed35e04b86820e4` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.810420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a264293ce21d4f4bbed35e04b86820e4)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:08.812994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:08.819039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:08.908117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:08.921010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:08.922464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:08.941793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a36d1-a01c-45fa-ba04-832d22c901af service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:08.949567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:08.949886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:08.950182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:08.950447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] PATH_INFO: `/v3/projects/db919d4517f749df8f52e102babab0e2` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:08.951716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=db919d4517f749df8f52e102babab0e2)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:08.953635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.004691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a264293ce21d4f4bbed35e04b86820e4', 'request_id': 'req-c3a4003c-5170-474d-b89c-d3011ff69b19'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.037711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a264293ce21d4f4bbed35e04b86820e4', 'request_id': 'req-c3a4003c-5170-474d-b89c-d3011ff69b19'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.055326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a264293ce21d4f4bbed35e04b86820e4', 'request_id': 'req-c3a4003c-5170-474d-b89c-d3011ff69b19'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.085073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db919d4517f749df8f52e102babab0e2', 'request_id': 'req-a0fec920-e305-4f48-acf4-f561deff1c7f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.092180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db919d4517f749df8f52e102babab0e2', 'request_id': 'req-a0fec920-e305-4f48-acf4-f561deff1c7f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.174998 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] The token cache is being invalidate because project a264293ce21d4f4bbed35e04b86820e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:09.175301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.176043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.182070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 893/1794] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:08 2022] DELETE /identity/v3/projects/a264293ce21d4f4bbed35e04b86820e4 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:09.184526 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.190010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:09.273736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db919d4517f749df8f52e102babab0e2', 'request_id': 'req-a0fec920-e305-4f48-acf4-f561deff1c7f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.301050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] The token cache is being invalidate because project db919d4517f749df8f52e102babab0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:09.303275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.305943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.315332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 902/1795] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:08 2022] DELETE /identity/v3/projects/db919d4517f749df8f52e102babab0e2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:09.316525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.322156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4003c-5170-474d-b89c-d3011ff69b19 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.324414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:09.408515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.411175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.412302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.412797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] PATH_INFO: `/v3/projects/bd56ddcc403f4557859d6d5a92f06d4d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.414428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd56ddcc403f4557859d6d5a92f06d4d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.416799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.473829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fec920-e305-4f48-acf4-f561deff1c7f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:09.479918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:09.480928 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.481204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.481431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] PATH_INFO: `/v3/projects/8ca1a6641a164a51b7a3ee857f21bdb4` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.482847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ca1a6641a164a51b7a3ee857f21bdb4)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:09.484938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:09.609813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd56ddcc403f4557859d6d5a92f06d4d', 'request_id': 'req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.619287 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd56ddcc403f4557859d6d5a92f06d4d', 'request_id': 'req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.626799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd56ddcc403f4557859d6d5a92f06d4d', 'request_id': 'req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.718475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ca1a6641a164a51b7a3ee857f21bdb4', 'request_id': 'req-bf6c99c7-48b9-4c09-a196-0b02da9000cd'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.731144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ca1a6641a164a51b7a3ee857f21bdb4', 'request_id': 'req-bf6c99c7-48b9-4c09-a196-0b02da9000cd'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.798143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] The token cache is being invalidate because project bd56ddcc403f4557859d6d5a92f06d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:09.798517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.806111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dad8cfa3-2824-4e7b-ba1b-bb4608c5559d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.821665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 894/1796] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:09 2022] DELETE /identity/v3/projects/bd56ddcc403f4557859d6d5a92f06d4d => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:09.823215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df06b-296a-41fb-85f8-3e63c72a16a3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:09.823508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df06b-296a-41fb-85f8-3e63c72a16a3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:09.823779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396df06b-296a-41fb-85f8-3e63c72a16a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:09.862122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-396df06b-296a-41fb-85f8-3e63c72a16a3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:09.863488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-396df06b-296a-41fb-85f8-3e63c72a16a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:09.891368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ca1a6641a164a51b7a3ee857f21bdb4', 'request_id': 'req-bf6c99c7-48b9-4c09-a196-0b02da9000cd'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.921698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] The token cache is being invalidate because project 8ca1a6641a164a51b7a3ee857f21bdb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:09.922379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.925553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:09.927762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 903/1797] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:09 2022] DELETE /identity/v3/projects/8ca1a6641a164a51b7a3ee857f21bdb4 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:09.933248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:09.935028 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:10.014638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 895/1798] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:10.015818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396df06b-296a-41fb-85f8-3e63c72a16a3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:10.026251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-396df06b-296a-41fb-85f8-3e63c72a16a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:10.060945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c99c7-48b9-4c09-a196-0b02da9000cd admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:10.061745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396df06b-296a-41fb-85f8-3e63c72a16a3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:10.067263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:10.068570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:10.068949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:10.069466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] PATH_INFO: `/v3/users/9ebc85c13a064ec7b7f60fa9aa13eac4` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:10.071145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ebc85c13a064ec7b7f60fa9aa13eac4)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:10.071535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:10.072465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:10.072753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:10.073030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] PATH_INFO: `/v3/users/0bc624e1d2914ed782459454386c3396` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:10.073725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:10.076674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bc624e1d2914ed782459454386c3396)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:10.078678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:10.379760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ebc85c13a064ec7b7f60fa9aa13eac4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.381497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ebc85c13a064ec7b7f60fa9aa13eac4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.386468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bc624e1d2914ed782459454386c3396'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.388178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bc624e1d2914ed782459454386c3396'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.390973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bc624e1d2914ed782459454386c3396'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.404148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ebc85c13a064ec7b7f60fa9aa13eac4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.425009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bc624e1d2914ed782459454386c3396'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.449348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ebc85c13a064ec7b7f60fa9aa13eac4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.452056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-b57f8778-3495-4438-a1da-7b76897cefb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ebc85c13a064ec7b7f60fa9aa13eac4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.452279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-737cd899-8c01-45ec-8e8b-6a1336ee8ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bc624e1d2914ed782459454386c3396'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:10.607871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 904/1799] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:09 2022] DELETE /identity/v3/users/9ebc85c13a064ec7b7f60fa9aa13eac4 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:10.612005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317b06-6c5a-4ad4-be3f-65c31b216387 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:10.612805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317b06-6c5a-4ad4-be3f-65c31b216387 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:10.613943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84317b06-6c5a-4ad4-be3f-65c31b216387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:10.648931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-84317b06-6c5a-4ad4-be3f-65c31b216387 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:10.650218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-84317b06-6c5a-4ad4-be3f-65c31b216387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:10.717457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 896/1800] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:10 2022] DELETE /identity/v3/users/0bc624e1d2914ed782459454386c3396 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:10.719582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899746-b807-4182-b1c6-569d76f78548 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:10.719898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899746-b807-4182-b1c6-569d76f78548 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:10.721614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18899746-b807-4182-b1c6-569d76f78548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:10.760759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-18899746-b807-4182-b1c6-569d76f78548 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:10.762923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-18899746-b807-4182-b1c6-569d76f78548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:10.783501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 905/1801] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:10.787767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ff91e-d738-4634-8def-12b3cdaa03ac None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:10.788067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ff91e-d738-4634-8def-12b3cdaa03ac None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:10.789659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ff91e-d738-4634-8def-12b3cdaa03ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:10.831845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-657ff91e-d738-4634-8def-12b3cdaa03ac None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:10.833099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-657ff91e-d738-4634-8def-12b3cdaa03ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:10.885083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 897/1802] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:10.889626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899746-b807-4182-b1c6-569d76f78548 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:10.905384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18899746-b807-4182-b1c6-569d76f78548 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:10.914214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:10.915520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:10.916374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:10.916983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:10.918728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:10.919413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:10.922959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:10.943223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 906/1803] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:10.944526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ff91e-d738-4634-8def-12b3cdaa03ac None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:10.948559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 898/1804] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:10.953700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:10.959833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ff91e-d738-4634-8def-12b3cdaa03ac None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:10.965242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:10.965954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:10.966217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:10.966499 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:10.967371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:10.967684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:10.969363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:10.970073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3555c6f-362b-4257-b4b4-d48825803e48 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:10.986242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 907/1805] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:10.993101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0420d5-8250-4395-9f84-0efeeb9ee730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:10.993263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:10.994482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0420d5-8250-4395-9f84-0efeeb9ee730 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:10.995094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0420d5-8250-4395-9f84-0efeeb9ee730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:10.996842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0420d5-8250-4395-9f84-0efeeb9ee730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:10.998373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0420d5-8250-4395-9f84-0efeeb9ee730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.004883 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0420d5-8250-4395-9f84-0efeeb9ee730 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.008735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123ce23-b9f4-49f7-9772-9e8ca29de6ba admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.014766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65132f-ee89-48af-a4b2-e75a06129824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.015678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65132f-ee89-48af-a4b2-e75a06129824 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.016077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65132f-ee89-48af-a4b2-e75a06129824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.017161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65132f-ee89-48af-a4b2-e75a06129824 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.033319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65132f-ee89-48af-a4b2-e75a06129824 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.043365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65132f-ee89-48af-a4b2-e75a06129824 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.170192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 899/1806] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:10 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:11.174341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0420d5-8250-4395-9f84-0efeeb9ee730 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.229150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 908/1807] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:10 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:11.239352 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65132f-ee89-48af-a4b2-e75a06129824 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.404718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65132f-ee89-48af-a4b2-e75a06129824 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.404825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0420d5-8250-4395-9f84-0efeeb9ee730 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.424362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc4761-41af-4e11-9dd4-2a3e1415e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.426090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc4761-41af-4e11-9dd4-2a3e1415e6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.426379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc4761-41af-4e11-9dd4-2a3e1415e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.426683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc4761-41af-4e11-9dd4-2a3e1415e6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.427418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc4761-41af-4e11-9dd4-2a3e1415e6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.429245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c45a0-16c4-4cf2-8e48-c4e1b82d6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.429423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc4761-41af-4e11-9dd4-2a3e1415e6f8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.430135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c45a0-16c4-4cf2-8e48-c4e1b82d6007 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.431345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c45a0-16c4-4cf2-8e48-c4e1b82d6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.433473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c45a0-16c4-4cf2-8e48-c4e1b82d6007 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.436352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c45a0-16c4-4cf2-8e48-c4e1b82d6007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.442487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c45a0-16c4-4cf2-8e48-c4e1b82d6007 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.606313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 909/1808] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:11 2022] POST /identity/v3/users => generated 287 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:11.609609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc4761-41af-4e11-9dd4-2a3e1415e6f8 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.635888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc4761-41af-4e11-9dd4-2a3e1415e6f8 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.650080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbee4c-e92f-4085-bba6-a0771100c3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.650793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbee4c-e92f-4085-bba6-a0771100c3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.651124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbee4c-e92f-4085-bba6-a0771100c3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.673003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 900/1809] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:11 2022] POST /identity/v3/users => generated 294 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:11.673207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fbee4c-e92f-4085-bba6-a0771100c3d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.673207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbee4c-e92f-4085-bba6-a0771100c3d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.674288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c45a0-16c4-4cf2-8e48-c4e1b82d6007 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.678163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fbee4c-e92f-4085-bba6-a0771100c3d3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.693134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c45a0-16c4-4cf2-8e48-c4e1b82d6007 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.697806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 910/1810] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:11.699042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.699747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.700091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.700382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.701335 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.703111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.705562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbee4c-e92f-4085-bba6-a0771100c3d3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.745846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fbee4c-e92f-4085-bba6-a0771100c3d3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.746123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 901/1811] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:11.746123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.746724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c48c22-be8f-4718-b898-d7d4eb9afc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.746724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c48c22-be8f-4718-b898-d7d4eb9afc6d admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.746724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c48c22-be8f-4718-b898-d7d4eb9afc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.746993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:11.747076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c48c22-be8f-4718-b898-d7d4eb9afc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.747076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c48c22-be8f-4718-b898-d7d4eb9afc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.748687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c48c22-be8f-4718-b898-d7d4eb9afc6d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.763918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac31cc-98be-4c34-89ec-5183bad2655a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.770809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 911/1812] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:11.774516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.774516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.774516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.774516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] PATH_INFO: `/v3/projects/eb575ac72ded4a7cbf25d148f6f34b4c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.775392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb575ac72ded4a7cbf25d148f6f34b4c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.776312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c48c22-be8f-4718-b898-d7d4eb9afc6d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.777750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.788802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c48c22-be8f-4718-b898-d7d4eb9afc6d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.793371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.794938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.795239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.795575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.796306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.798046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.809468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 912/1813] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:11.810468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:11.812466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:11.827375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b033a99-a15f-429f-a37b-533516cae48a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:11.833335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:11.834245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:11.834686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:11.834970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] PATH_INFO: `/v3/projects/7553e7950e244a2db9c1d80134f03593` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:11.836170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7553e7950e244a2db9c1d80134f03593)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:11.838078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:11.973950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb575ac72ded4a7cbf25d148f6f34b4c', 'request_id': 'req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:11.983916 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb575ac72ded4a7cbf25d148f6f34b4c', 'request_id': 'req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:11.989324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb575ac72ded4a7cbf25d148f6f34b4c', 'request_id': 'req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:12.020661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7553e7950e244a2db9c1d80134f03593', 'request_id': 'req-ad88b7e2-b05f-4576-ab38-1187a6138dd3'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:12.026933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7553e7950e244a2db9c1d80134f03593', 'request_id': 'req-ad88b7e2-b05f-4576-ab38-1187a6138dd3'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:12.155701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] The token cache is being invalidate because project eb575ac72ded4a7cbf25d148f6f34b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:12.164521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:12.164521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:12.164521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 902/1814] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:11 2022] DELETE /identity/v3/projects/eb575ac72ded4a7cbf25d148f6f34b4c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:12.164521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:12.164521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.232153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4e92d-cb67-4e3b-8606-d39a5a0008b6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:12.278961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7553e7950e244a2db9c1d80134f03593', 'request_id': 'req-ad88b7e2-b05f-4576-ab38-1187a6138dd3'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:12.301498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] The token cache is being invalidate because project 7553e7950e244a2db9c1d80134f03593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:12.303686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:12.303889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:12.305598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 913/1815] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:11 2022] DELETE /identity/v3/projects/7553e7950e244a2db9c1d80134f03593 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:12.312036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:12.314118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.345034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de2e5e-1083-4d10-a7c4-b5bd77ab3c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:12.347334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2e5e-1083-4d10-a7c4-b5bd77ab3c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.347777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2e5e-1083-4d10-a7c4-b5bd77ab3c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.348262 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de2e5e-1083-4d10-a7c4-b5bd77ab3c9d admin admin] PATH_INFO: `/v3/projects/05eea16eae2b4e57a6dcff0f105f23ec/users/57532fb4488d4781beb860f6041cbfcd/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.367207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de2e5e-1083-4d10-a7c4-b5bd77ab3c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05eea16eae2b4e57a6dcff0f105f23ec, user_id=57532fb4488d4781beb860f6041cbfcd, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:12.370164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de2e5e-1083-4d10-a7c4-b5bd77ab3c9d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:12.376108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:12.408417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88b7e2-b05f-4576-ab38-1187a6138dd3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:12.413887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1aa42-b884-485e-8bb2-c153cc48870a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:12.418692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1aa42-b884-485e-8bb2-c153cc48870a admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.418692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1aa42-b884-485e-8bb2-c153cc48870a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.418692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1aa42-b884-485e-8bb2-c153cc48870a admin admin] PATH_INFO: `/v3/projects/5f48f4d4cff440f18a7b617126e2be59/users/02c17f90e52d4ea09561b61597df707a/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.431662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1aa42-b884-485e-8bb2-c153cc48870a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f48f4d4cff440f18a7b617126e2be59, user_id=02c17f90e52d4ea09561b61597df707a, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:12.434485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1aa42-b884-485e-8bb2-c153cc48870a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:12.523329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 903/1816] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:12 2022] PUT /identity/v3/projects/05eea16eae2b4e57a6dcff0f105f23ec/users/57532fb4488d4781beb860f6041cbfcd/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:12.538896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91228af6-45cc-4638-92ad-cac6f57fa95c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.538896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91228af6-45cc-4638-92ad-cac6f57fa95c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.538896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91228af6-45cc-4638-92ad-cac6f57fa95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.553223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-91228af6-45cc-4638-92ad-cac6f57fa95c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:12.554456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-91228af6-45cc-4638-92ad-cac6f57fa95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.586864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 914/1817] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:12 2022] PUT /identity/v3/projects/5f48f4d4cff440f18a7b617126e2be59/users/02c17f90e52d4ea09561b61597df707a/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:12.588347 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83db9f-1b15-444c-a0e8-d7573bef334e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.588659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83db9f-1b15-444c-a0e8-d7573bef334e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.588958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83db9f-1b15-444c-a0e8-d7573bef334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.614049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ef83db9f-1b15-444c-a0e8-d7573bef334e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:12.617005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ef83db9f-1b15-444c-a0e8-d7573bef334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.647350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 904/1818] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:12.647350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c067e4-8481-48f9-9049-41bdcebc29ee None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.647350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c067e4-8481-48f9-9049-41bdcebc29ee None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.647350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c067e4-8481-48f9-9049-41bdcebc29ee None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.647350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 905/1819] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:48:12.647350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f58e1-7038-4af1-8f4d-4d960fd92869 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.647350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f58e1-7038-4af1-8f4d-4d960fd92869 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.647829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f58e1-7038-4af1-8f4d-4d960fd92869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.682380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-114f58e1-7038-4af1-8f4d-4d960fd92869 None None] MFA Rules not processed for user `57532fb4488d4781beb860f6041cbfcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:12.684179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-114f58e1-7038-4af1-8f4d-4d960fd92869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.692476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:12.729795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 915/1820] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:12.733911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a47e-7fa0-4d96-9931-30af8fdfdecb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.733911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a47e-7fa0-4d96-9931-30af8fdfdecb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.733911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4084a47e-7fa0-4d96-9931-30af8fdfdecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.778560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4084a47e-7fa0-4d96-9931-30af8fdfdecb None None] MFA Rules not processed for user `02c17f90e52d4ea09561b61597df707a`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:12.780324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4084a47e-7fa0-4d96-9931-30af8fdfdecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.801752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 906/1821] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:12.804211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629af80-03fc-40c9-beb2-61bfb7156ea8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.804752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629af80-03fc-40c9-beb2-61bfb7156ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.804959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6629af80-03fc-40c9-beb2-61bfb7156ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.827246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6629af80-03fc-40c9-beb2-61bfb7156ea8 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:12.831498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6629af80-03fc-40c9-beb2-61bfb7156ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.847976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 907/1822] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:12.852721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7026de-1cdb-4252-aef9-d0c1631ef8e4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.853272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7026de-1cdb-4252-aef9-d0c1631ef8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.853716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7026de-1cdb-4252-aef9-d0c1631ef8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.884255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 916/1823] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:12.884785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5e680-22c7-47b6-b1af-80b27a79ac6c None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.890807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5e680-22c7-47b6-b1af-80b27a79ac6c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.890807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5e680-22c7-47b6-b1af-80b27a79ac6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.891001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0d7026de-1cdb-4252-aef9-d0c1631ef8e4 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:12.891001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0d7026de-1cdb-4252-aef9-d0c1631ef8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.909553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-61d5e680-22c7-47b6-b1af-80b27a79ac6c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:12.912022 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-61d5e680-22c7-47b6-b1af-80b27a79ac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.922325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 917/1824] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:12.922849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5e680-22c7-47b6-b1af-80b27a79ac6c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:12.933951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5e680-22c7-47b6-b1af-80b27a79ac6c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:12.939103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:12.940026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:12.940451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:12.940725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:12.941458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:12.941770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:12.944364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:12.961561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 918/1825] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:12.961561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:12.964146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:12.989536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 908/1826] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:48:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:12.990557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7026de-1cdb-4252-aef9-d0c1631ef8e4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.003367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7026de-1cdb-4252-aef9-d0c1631ef8e4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.009346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410046-3e87-40f8-a789-fe75e9ada192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.010120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410046-3e87-40f8-a789-fe75e9ada192 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.010468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410046-3e87-40f8-a789-fe75e9ada192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.010989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1410046-3e87-40f8-a789-fe75e9ada192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.011834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410046-3e87-40f8-a789-fe75e9ada192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.013992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1410046-3e87-40f8-a789-fe75e9ada192 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.062479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab11af7-3f42-4f4a-8d42-c9d1cb8b3def admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.068498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f92751-225f-4401-b457-111e52fa6502 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.069213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92751-225f-4401-b457-111e52fa6502 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.069517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92751-225f-4401-b457-111e52fa6502 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.069779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f92751-225f-4401-b457-111e52fa6502 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.078456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f92751-225f-4401-b457-111e52fa6502 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.080177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f92751-225f-4401-b457-111e52fa6502 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.090218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 919/1827] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:13.091179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f92751-225f-4401-b457-111e52fa6502 service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.101757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f92751-225f-4401-b457-111e52fa6502 service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.106888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.107567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.107853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.108126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.108906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:13.109547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.110904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.138338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 909/1828] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:12 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:13.138338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410046-3e87-40f8-a789-fe75e9ada192 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.138599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 920/1829] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:13.138599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.138599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:13.147718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08095a1f-2983-428a-8569-d634fe6511b7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.219341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1410046-3e87-40f8-a789-fe75e9ada192 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.226773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adc23f-281d-42d5-b3d4-a11a64dd1790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.227726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc23f-281d-42d5-b3d4-a11a64dd1790 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.228023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc23f-281d-42d5-b3d4-a11a64dd1790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.228311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adc23f-281d-42d5-b3d4-a11a64dd1790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.229007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adc23f-281d-42d5-b3d4-a11a64dd1790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.231001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adc23f-281d-42d5-b3d4-a11a64dd1790 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.258873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5ba0f-c534-48b6-acad-d00f7544192c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.258873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5ba0f-c534-48b6-acad-d00f7544192c service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.258873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5ba0f-c534-48b6-acad-d00f7544192c service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.258873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5ba0f-c534-48b6-acad-d00f7544192c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.266926 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5ba0f-c534-48b6-acad-d00f7544192c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.268825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe5ba0f-c534-48b6-acad-d00f7544192c service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.281629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 921/1830] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:13.282579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5ba0f-c534-48b6-acad-d00f7544192c service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.297797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5ba0f-c534-48b6-acad-d00f7544192c service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.303479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dbcd7-9cd8-48df-ab70-e885ddd5068c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.304171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbcd7-9cd8-48df-ab70-e885ddd5068c admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.304453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbcd7-9cd8-48df-ab70-e885ddd5068c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.304732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbcd7-9cd8-48df-ab70-e885ddd5068c admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.306040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dbcd7-9cd8-48df-ab70-e885ddd5068c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.308067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dbcd7-9cd8-48df-ab70-e885ddd5068c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.378573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 910/1831] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:13 2022] POST /identity/v3/projects => generated 377 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:13.378573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adc23f-281d-42d5-b3d4-a11a64dd1790 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.435606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 922/1832] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:13 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:13.435606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dbcd7-9cd8-48df-ab70-e885ddd5068c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.445060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dbcd7-9cd8-48df-ab70-e885ddd5068c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.531160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db06fa-c8fa-4cf6-93e9-4a3c8c7f1243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.531803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db06fa-c8fa-4cf6-93e9-4a3c8c7f1243 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.532552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db06fa-c8fa-4cf6-93e9-4a3c8c7f1243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.532731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db06fa-c8fa-4cf6-93e9-4a3c8c7f1243 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.533425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db06fa-c8fa-4cf6-93e9-4a3c8c7f1243 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.535382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db06fa-c8fa-4cf6-93e9-4a3c8c7f1243 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.535840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adc23f-281d-42d5-b3d4-a11a64dd1790 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.541233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.541908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.542193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.542552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.543200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.545111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.650702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 923/1833] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:13 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:13.651607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db06fa-c8fa-4cf6-93e9-4a3c8c7f1243 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.664829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db06fa-c8fa-4cf6-93e9-4a3c8c7f1243 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.670873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256b060-07f3-4458-8994-92d1f262e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.671803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b060-07f3-4458-8994-92d1f262e116 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.672378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b060-07f3-4458-8994-92d1f262e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.672662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4256b060-07f3-4458-8994-92d1f262e116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.673396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256b060-07f3-4458-8994-92d1f262e116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.675051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4256b060-07f3-4458-8994-92d1f262e116 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.684318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 911/1834] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:13 2022] POST /identity/v3/projects => generated 385 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:13.685684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.687448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 924/1835] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:13.688511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256b060-07f3-4458-8994-92d1f262e116 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.691671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:13.700581 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4256b060-07f3-4458-8994-92d1f262e116 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.783140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4508f1-f8d4-42ec-be4f-5f8686d4d354 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.789308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.791371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.791699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.791993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] PATH_INFO: `/v3/users/57532fb4488d4781beb860f6041cbfcd` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.793341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=57532fb4488d4781beb860f6041cbfcd)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.795366 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.815767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a3faf-d94e-4d38-b159-d038e63c6ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.819431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3faf-d94e-4d38-b159-d038e63c6ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.819431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3faf-d94e-4d38-b159-d038e63c6ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.819431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a3faf-d94e-4d38-b159-d038e63c6ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.819431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a3faf-d94e-4d38-b159-d038e63c6ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.821674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a3faf-d94e-4d38-b159-d038e63c6ef3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:13.840817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 925/1836] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:13 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:13.841930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a3faf-d94e-4d38-b159-d038e63c6ef3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:13.855142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a3faf-d94e-4d38-b159-d038e63c6ef3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:13.862975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864c734-3ce4-4940-b975-0928ad3a7755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:13.863543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c734-3ce4-4940-b975-0928ad3a7755 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:13.863824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c734-3ce4-4940-b975-0928ad3a7755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:13.864143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c734-3ce4-4940-b975-0928ad3a7755 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:13.865576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864c734-3ce4-4940-b975-0928ad3a7755 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:13.867565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864c734-3ce4-4940-b975-0928ad3a7755 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.000707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 926/1837] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:13 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:14.002257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864c734-3ce4-4940-b975-0928ad3a7755 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.046326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864c734-3ce4-4940-b975-0928ad3a7755 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.060194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.061073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.061361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.061644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] PATH_INFO: `/v3/projects/3d4e7fbb148943d599780f275c63faca/users/3301290975f849b891e9224275dfea8e/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.098846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4e7fbb148943d599780f275c63faca, user_id=3301290975f849b891e9224275dfea8e, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.105507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.162707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57532fb4488d4781beb860f6041cbfcd'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.164546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57532fb4488d4781beb860f6041cbfcd'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.165333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57532fb4488d4781beb860f6041cbfcd'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.182446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57532fb4488d4781beb860f6041cbfcd'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.201108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57532fb4488d4781beb860f6041cbfcd'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.267077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 927/1838] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:14 2022] PUT /identity/v3/projects/3d4e7fbb148943d599780f275c63faca/users/3301290975f849b891e9224275dfea8e/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:14.271592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.280840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:14.315176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 912/1839] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:13 2022] DELETE /identity/v3/users/57532fb4488d4781beb860f6041cbfcd => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:14.317320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.320053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:14.383366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e67d4d-3cf1-4867-9633-6ff421735e95 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.425070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92761bf2-cd9f-4d8b-82dc-9e7254d923dd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.436753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.437056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.437339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.437664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.438424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.440385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.454515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3647fd1f-d1f0-41e5-bdbc-3ef9687ffdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.455434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fd1f-d1f0-41e5-bdbc-3ef9687ffdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.455854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fd1f-d1f0-41e5-bdbc-3ef9687ffdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.456263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3647fd1f-d1f0-41e5-bdbc-3ef9687ffdc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.457334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647fd1f-d1f0-41e5-bdbc-3ef9687ffdc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.457639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 913/1840] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:14.459078 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.460144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3647fd1f-d1f0-41e5-bdbc-3ef9687ffdc4 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.463014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:14.475976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 928/1841] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:14.477643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb0877-0cc8-4e59-9de3-77e55b32cb84 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.478341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb0877-0cc8-4e59-9de3-77e55b32cb84 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.478813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb0877-0cc8-4e59-9de3-77e55b32cb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.480256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b553b-413d-4293-9a1b-7f928951494c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.494111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.494111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.494111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.494111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.494693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.494693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.501969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7bdb0877-0cc8-4e59-9de3-77e55b32cb84 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:14.503048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 914/1842] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:14.503319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7bdb0877-0cc8-4e59-9de3-77e55b32cb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:14.507576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.509461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:14.512157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 929/1843] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:14.512956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb0877-0cc8-4e59-9de3-77e55b32cb84 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.524172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb0877-0cc8-4e59-9de3-77e55b32cb84 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.524965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470845c-48ca-46e6-93c8-0ffd370a5021 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.528889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c093a15-7bef-4acf-8e5d-5d7619dcbc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.529560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c093a15-7bef-4acf-8e5d-5d7619dcbc8e admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.529801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.529922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c093a15-7bef-4acf-8e5d-5d7619dcbc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.530091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c093a15-7bef-4acf-8e5d-5d7619dcbc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.530849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c093a15-7bef-4acf-8e5d-5d7619dcbc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.530951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.531192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.531548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] PATH_INFO: `/v3/users/a78b2ac393384bceb74b9418d784ff0d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.532540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c093a15-7bef-4acf-8e5d-5d7619dcbc8e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.532636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78b2ac393384bceb74b9418d784ff0d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.534558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.547140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 930/1844] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:14.547140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c093a15-7bef-4acf-8e5d-5d7619dcbc8e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.556559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c093a15-7bef-4acf-8e5d-5d7619dcbc8e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.561307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365b033-37eb-4477-9aff-9bd250d267dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.562267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365b033-37eb-4477-9aff-9bd250d267dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.562550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365b033-37eb-4477-9aff-9bd250d267dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.562905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365b033-37eb-4477-9aff-9bd250d267dc admin admin] PATH_INFO: `/v3/projects/5634ef7ae99a4b299e0ba317d373ffd1/users/6eab7becb7bd4096b785a725b2964340/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.577631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365b033-37eb-4477-9aff-9bd250d267dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5634ef7ae99a4b299e0ba317d373ffd1, user_id=6eab7becb7bd4096b785a725b2964340, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.580427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365b033-37eb-4477-9aff-9bd250d267dc admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.693762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:14.699241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 931/1845] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:14 2022] PUT /identity/v3/projects/5634ef7ae99a4b299e0ba317d373ffd1/users/6eab7becb7bd4096b785a725b2964340/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:14.700147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365b033-37eb-4477-9aff-9bd250d267dc admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.746936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78b2ac393384bceb74b9418d784ff0d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.747509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78b2ac393384bceb74b9418d784ff0d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.748114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78b2ac393384bceb74b9418d784ff0d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.760843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78b2ac393384bceb74b9418d784ff0d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.762983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365b033-37eb-4477-9aff-9bd250d267dc admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.767900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.768041 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78b2ac393384bceb74b9418d784ff0d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:14.768837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.769119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.769432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] PATH_INFO: `/v3/projects/3d4e7fbb148943d599780f275c63faca/users/3301290975f849b891e9224275dfea8e/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.772288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4e7fbb148943d599780f275c63faca, user_id=3301290975f849b891e9224275dfea8e, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.774994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.785698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 932/1846] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:14 2022] PUT /identity/v3/projects/3d4e7fbb148943d599780f275c63faca/users/3301290975f849b891e9224275dfea8e/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:14.786835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.788427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:14.841198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 915/1847] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:14 2022] DELETE /identity/v3/users/a78b2ac393384bceb74b9418d784ff0d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:14.842659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:14.844686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:14.852730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:14.856058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d60fc-aa79-4aa1-95d0-91bebb0c2fc5 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.916495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ceca2-a7a4-47cb-84c9-43150f3af035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.917341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ceca2-a7a4-47cb-84c9-43150f3af035 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.917878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ceca2-a7a4-47cb-84c9-43150f3af035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.918394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ceca2-a7a4-47cb-84c9-43150f3af035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.920922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-996ceca2-a7a4-47cb-84c9-43150f3af035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:14.927241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb006742-c7e2-458a-8389-753ef4b97960 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:14.934182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ec72f-421a-45e1-b676-7b411d1d0097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:14.935228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec72f-421a-45e1-b676-7b411d1d0097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.935511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec72f-421a-45e1-b676-7b411d1d0097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.935786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ec72f-421a-45e1-b676-7b411d1d0097 admin admin] PATH_INFO: `/v3/projects/3283799d5e4b44b79508e9292ec7c10c/users/a16cc0b17b1a40a199a9b60eb5a188fc/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.936606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ceca2-a7a4-47cb-84c9-43150f3af035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.938258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ceca2-a7a4-47cb-84c9-43150f3af035 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.953180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ec72f-421a-45e1-b676-7b411d1d0097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3283799d5e4b44b79508e9292ec7c10c, user_id=a16cc0b17b1a40a199a9b60eb5a188fc, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:14.956340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389ec72f-421a-45e1-b676-7b411d1d0097 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:14.958983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 933/1848] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:14.966344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc48a-15c2-457a-b2eb-862b8cb8774e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:14.966648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc48a-15c2-457a-b2eb-862b8cb8774e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:14.967053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc48a-15c2-457a-b2eb-862b8cb8774e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:14.998032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-fd5fc48a-15c2-457a-b2eb-862b8cb8774e None None] MFA Rules not processed for user `6eab7becb7bd4096b785a725b2964340`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:14.999212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fd5fc48a-15c2-457a-b2eb-862b8cb8774e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.073172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 916/1849] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:14 2022] PUT /identity/v3/projects/3283799d5e4b44b79508e9292ec7c10c/users/a16cc0b17b1a40a199a9b60eb5a188fc/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:15.075427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8492-83a2-4999-ab6d-5b5312a13914 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.075654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8492-83a2-4999-ab6d-5b5312a13914 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.076590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e8492-83a2-4999-ab6d-5b5312a13914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.088194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 934/1850] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:15.088194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f75d89-ef4e-4be2-80ef-43c00e5a6068 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.088194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f75d89-ef4e-4be2-80ef-43c00e5a6068 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.088194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f75d89-ef4e-4be2-80ef-43c00e5a6068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.106877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b7f75d89-ef4e-4be2-80ef-43c00e5a6068 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:15.107549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a11e8492-83a2-4999-ab6d-5b5312a13914 None None] MFA Rules not processed for user `3301290975f849b891e9224275dfea8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:15.110058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a11e8492-83a2-4999-ab6d-5b5312a13914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.110185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b7f75d89-ef4e-4be2-80ef-43c00e5a6068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.183450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 935/1851] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:15.188130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c183-d7b0-45e3-ae70-1e44f138e092 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.190149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c183-d7b0-45e3-ae70-1e44f138e092 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.191199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594c183-d7b0-45e3-ae70-1e44f138e092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.198080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 917/1852] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:15.199568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8492-83a2-4999-ab6d-5b5312a13914 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:15.200888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a11e8492-83a2-4999-ab6d-5b5312a13914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.217787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11e8492-83a2-4999-ab6d-5b5312a13914 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:15.224220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:15.225005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.225338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.225620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.226866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:15.229389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:15.235659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-3594c183-d7b0-45e3-ae70-1e44f138e092 None None] MFA Rules not processed for user `a16cc0b17b1a40a199a9b60eb5a188fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:15.236916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3594c183-d7b0-45e3-ae70-1e44f138e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.315555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 936/1853] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:15.316514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c183-d7b0-45e3-ae70-1e44f138e092 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:15.318270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3594c183-d7b0-45e3-ae70-1e44f138e092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.387304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594c183-d7b0-45e3-ae70-1e44f138e092 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:15.391231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29c23f-ce9b-44b0-9eb8-cf65f1ee2182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:15.391927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29c23f-ce9b-44b0-9eb8-cf65f1ee2182 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.392206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29c23f-ce9b-44b0-9eb8-cf65f1ee2182 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.392479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29c23f-ce9b-44b0-9eb8-cf65f1ee2182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.404442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29c23f-ce9b-44b0-9eb8-cf65f1ee2182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:15.405898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29c23f-ce9b-44b0-9eb8-cf65f1ee2182 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:15.407194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 918/1854] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:15 2022] POST /identity/v3/projects => generated 375 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:15.413195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:15.415007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.426734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 937/1855] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:15.429004 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29c23f-ce9b-44b0-9eb8-cf65f1ee2182 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:15.446723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29c23f-ce9b-44b0-9eb8-cf65f1ee2182 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:15.511923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f578b-88fc-4b07-a668-6b4650b31559 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:15.516354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815f767-9b96-4a19-909d-9d7949c4435f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:15.517029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815f767-9b96-4a19-909d-9d7949c4435f service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.517809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815f767-9b96-4a19-909d-9d7949c4435f service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.517809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815f767-9b96-4a19-909d-9d7949c4435f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.548657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:15.549618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.553487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.553487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.553487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:15.554249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:15.618149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815f767-9b96-4a19-909d-9d7949c4435f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:15.619820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7815f767-9b96-4a19-909d-9d7949c4435f service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:15.633275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 919/1856] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:15.634376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815f767-9b96-4a19-909d-9d7949c4435f service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:15.650964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815f767-9b96-4a19-909d-9d7949c4435f service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:15.653846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ca2ff-1f8e-478a-a498-6517ca2d321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:15.654663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca2ff-1f8e-478a-a498-6517ca2d321b admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.655050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca2ff-1f8e-478a-a498-6517ca2d321b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.655376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ca2ff-1f8e-478a-a498-6517ca2d321b admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.656432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ca2ff-1f8e-478a-a498-6517ca2d321b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:15.658710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ca2ff-1f8e-478a-a498-6517ca2d321b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:15.735536 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 938/1857] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:15 2022] POST /identity/v3/projects => generated 387 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:15.735737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:15.741124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.817381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 920/1858] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:15 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:15.818406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ca2ff-1f8e-478a-a498-6517ca2d321b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:15.832002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ca2ff-1f8e-478a-a498-6517ca2d321b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:15.839437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:15.840138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.840427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.840710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.841443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:15.843431 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:15.847404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26748f47-a6df-4b95-adc3-282c33e451a8 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:15.853539 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:15.854706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.860331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.860331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] PATH_INFO: `/v3/users/02c17f90e52d4ea09561b61597df707a` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.860331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] RBAC: Authorizing `identity:delete_user(user_id=02c17f90e52d4ea09561b61597df707a)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:15.860331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:15.970600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 921/1859] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:15 2022] POST /identity/v3/users => generated 300 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:15.970600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:15.970600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:15.983414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55624-3dad-4ea5-a9ec-0a94925ba369 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:15.987961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:15.988902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:15.989185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:15.991947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] PATH_INFO: `/v3/projects/05eea16eae2b4e57a6dcff0f105f23ec` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:15.991947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=05eea16eae2b4e57a6dcff0f105f23ec)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:15.993045 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:16.125532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02c17f90e52d4ea09561b61597df707a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.126353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02c17f90e52d4ea09561b61597df707a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.131329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05eea16eae2b4e57a6dcff0f105f23ec', 'request_id': 'req-41e06d9f-3d7a-451b-8980-2a3274ada33f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.134636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02c17f90e52d4ea09561b61597df707a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.138288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05eea16eae2b4e57a6dcff0f105f23ec', 'request_id': 'req-41e06d9f-3d7a-451b-8980-2a3274ada33f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.144107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05eea16eae2b4e57a6dcff0f105f23ec', 'request_id': 'req-41e06d9f-3d7a-451b-8980-2a3274ada33f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.147463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02c17f90e52d4ea09561b61597df707a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.148222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9e95b6ef-30e3-4e14-a154-f9f6a719528c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02c17f90e52d4ea09561b61597df707a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.287131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:16.293581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] The token cache is being invalidate because project 05eea16eae2b4e57a6dcff0f105f23ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:16.294123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.294551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.296398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 922/1860] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:15 2022] DELETE /identity/v3/projects/05eea16eae2b4e57a6dcff0f105f23ec => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:16.296908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:16.298200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:16.367960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e06d9f-3d7a-451b-8980-2a3274ada33f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:16.373296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:16.373296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.373577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.373799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.374576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:16.376194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:16.388082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 923/1861] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:16.389037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:16.390974 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:16.405004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233bbb2-9bef-469a-a089-7d191fedc1f8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:16.409717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:16.410391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.410709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.411248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.412955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:16.414597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:16.424979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 924/1862] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:16.425915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:16.429787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:16.442424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c036-d28c-40de-bb3f-e65984440d6f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:16.447451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:16.448315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.448596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.448872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] PATH_INFO: `/v3/projects/dea7eaa497294732a678ae3148d6e234` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.450049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea7eaa497294732a678ae3148d6e234)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:16.451965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:16.528231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 939/1863] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:15 2022] DELETE /identity/v3/users/02c17f90e52d4ea09561b61597df707a => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:16.529636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2805-e044-465e-ba83-deb6a49ca235 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.529944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2805-e044-465e-ba83-deb6a49ca235 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.530211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e2805-e044-465e-ba83-deb6a49ca235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.551226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-702e2805-e044-465e-ba83-deb6a49ca235 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:16.553394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-702e2805-e044-465e-ba83-deb6a49ca235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:16.617942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 940/1864] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:16.618880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e2805-e044-465e-ba83-deb6a49ca235 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:16.628392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e2805-e044-465e-ba83-deb6a49ca235 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:16.633284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f92e10-c586-48a8-bd26-0f53764a19ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:16.634192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f92e10-c586-48a8-bd26-0f53764a19ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.634458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f92e10-c586-48a8-bd26-0f53764a19ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.634767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f92e10-c586-48a8-bd26-0f53764a19ae admin admin] PATH_INFO: `/v3/projects/2912c85791844d97b7a38582c2f255ea/users/93cee88439234d329153cf3797f523f0/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.651221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f92e10-c586-48a8-bd26-0f53764a19ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2912c85791844d97b7a38582c2f255ea, user_id=93cee88439234d329153cf3797f523f0, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:16.653876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f92e10-c586-48a8-bd26-0f53764a19ae admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:16.659245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea7eaa497294732a678ae3148d6e234', 'request_id': 'req-5c93a31e-7543-41d4-a881-e3caa5281d6c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.666871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea7eaa497294732a678ae3148d6e234', 'request_id': 'req-5c93a31e-7543-41d4-a881-e3caa5281d6c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.672326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea7eaa497294732a678ae3148d6e234', 'request_id': 'req-5c93a31e-7543-41d4-a881-e3caa5281d6c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.762551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 941/1865] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:16 2022] PUT /identity/v3/projects/2912c85791844d97b7a38582c2f255ea/users/93cee88439234d329153cf3797f523f0/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:16.763530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f92e10-c586-48a8-bd26-0f53764a19ae admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:16.780288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] The token cache is being invalidate because project dea7eaa497294732a678ae3148d6e234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:16.780288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.780288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5c93a31e-7543-41d4-a881-e3caa5281d6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:16.782181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 925/1866] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:16 2022] DELETE /identity/v3/projects/dea7eaa497294732a678ae3148d6e234 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:16.783508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568afbc0-f592-4901-8e6b-39a52d48c6ca None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.783863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568afbc0-f592-4901-8e6b-39a52d48c6ca None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.784218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568afbc0-f592-4901-8e6b-39a52d48c6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.803605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-568afbc0-f592-4901-8e6b-39a52d48c6ca None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:16.804836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-568afbc0-f592-4901-8e6b-39a52d48c6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:16.854992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f92e10-c586-48a8-bd26-0f53764a19ae admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:16.867418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4a526-867e-4383-8cff-657c65d4b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:16.868367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4a526-867e-4383-8cff-657c65d4b079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.871529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 926/1867] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:16.871654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4a526-867e-4383-8cff-657c65d4b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.871654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e4a526-867e-4383-8cff-657c65d4b079 admin admin] PATH_INFO: `/v3/projects/8df5a272438243fab52526418bfdfaa0/users/0adc45395f904f6b99aa16de3314c7ab/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.871816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a9b56-dea3-4297-b655-7c44cbd26219 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.871816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a9b56-dea3-4297-b655-7c44cbd26219 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.871816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a9b56-dea3-4297-b655-7c44cbd26219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.886436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4a526-867e-4383-8cff-657c65d4b079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df5a272438243fab52526418bfdfaa0, user_id=0adc45395f904f6b99aa16de3314c7ab, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:16.889158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e4a526-867e-4383-8cff-657c65d4b079 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:16.893714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-739a9b56-dea3-4297-b655-7c44cbd26219 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:16.893714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-739a9b56-dea3-4297-b655-7c44cbd26219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:16.901451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 927/1868] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:16.902391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a9b56-dea3-4297-b655-7c44cbd26219 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:16.903740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-739a9b56-dea3-4297-b655-7c44cbd26219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:16.917279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a9b56-dea3-4297-b655-7c44cbd26219 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:16.927853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:16.927853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:16.927853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.927853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.928226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.928433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:16.930110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:16.941245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 928/1869] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:16.942210 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:16.944528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:16.957585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cadb47-5614-4b08-bff1-4df70041569c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:16.962981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:16.968189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:16.968189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:16.968189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] PATH_INFO: `/v3/users/af7416a79d884a7e86a24c4503a33d33` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:16.968189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af7416a79d884a7e86a24c4503a33d33)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:16.968189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.052354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 942/1870] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:16 2022] PUT /identity/v3/projects/8df5a272438243fab52526418bfdfaa0/users/0adc45395f904f6b99aa16de3314c7ab/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:17.053205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4a526-867e-4383-8cff-657c65d4b079 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.119259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e4a526-867e-4383-8cff-657c65d4b079 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.123923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.124590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.124875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.125152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.125882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:17.126406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.128388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.140703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 943/1871] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:17.141759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.143453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.201915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1b5d7-86a1-41f8-93e4-65861323da1b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.205562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e11b-343f-4f45-98a6-d98a371998a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.206212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e11b-343f-4f45-98a6-d98a371998a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.206496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e11b-343f-4f45-98a6-d98a371998a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.206796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369e11b-343f-4f45-98a6-d98a371998a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.217106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369e11b-343f-4f45-98a6-d98a371998a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.218513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369e11b-343f-4f45-98a6-d98a371998a4 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.228651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 944/1872] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:17.229436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e11b-343f-4f45-98a6-d98a371998a4 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.238928 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369e11b-343f-4f45-98a6-d98a371998a4 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.244129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.245078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.245354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.245629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] PATH_INFO: `/v3/projects/2912c85791844d97b7a38582c2f255ea/users/93cee88439234d329153cf3797f523f0/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.247645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2912c85791844d97b7a38582c2f255ea, user_id=93cee88439234d329153cf3797f523f0, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.250446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.263974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 945/1873] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:17 2022] PUT /identity/v3/projects/2912c85791844d97b7a38582c2f255ea/users/93cee88439234d329153cf3797f523f0/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:17.264872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.267042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.285714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af7416a79d884a7e86a24c4503a33d33'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:17.286961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af7416a79d884a7e86a24c4503a33d33'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:17.287957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af7416a79d884a7e86a24c4503a33d33'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:17.301547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af7416a79d884a7e86a24c4503a33d33'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:17.312026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a088268d-04de-4c04-a2c2-1904218e3698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af7416a79d884a7e86a24c4503a33d33'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:17.345663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97826b4f-24d7-46ec-a05e-e1c31a30ef5d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.351032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.351743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.352026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.352302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.353025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.354627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.364326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 946/1874] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:17.365837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.367854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.382916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff330bb1-fdf1-4096-a5c4-233414b9f12b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.388408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.389080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.389364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.389639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.390328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.392330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.429296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 929/1875] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:16 2022] DELETE /identity/v3/users/af7416a79d884a7e86a24c4503a33d33 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:17.430636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc6418-6fea-423b-ac4a-0b20bfcd3a0b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.430927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc6418-6fea-423b-ac4a-0b20bfcd3a0b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.431204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc6418-6fea-423b-ac4a-0b20bfcd3a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.471236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-31bc6418-6fea-423b-ac4a-0b20bfcd3a0b None None] MFA Rules not processed for user `93cee88439234d329153cf3797f523f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:17.472666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-31bc6418-6fea-423b-ac4a-0b20bfcd3a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.519642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 947/1876] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:17 2022] POST /identity/v3/projects => generated 405 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:17.520356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.523060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.585696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 930/1877] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:17.586947 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc6418-6fea-423b-ac4a-0b20bfcd3a0b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.618159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ce224-8bcb-4adc-9b52-ce79b1bb9fa3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.634044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.634237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.634661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.634952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] PATH_INFO: `/v3/projects/8df5a272438243fab52526418bfdfaa0/users/0adc45395f904f6b99aa16de3314c7ab/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.637122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df5a272438243fab52526418bfdfaa0, user_id=0adc45395f904f6b99aa16de3314c7ab, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.639678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.651364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 948/1878] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:17 2022] PUT /identity/v3/projects/8df5a272438243fab52526418bfdfaa0/users/0adc45395f904f6b99aa16de3314c7ab/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:17.658091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.660325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.673981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc6418-6fea-423b-ac4a-0b20bfcd3a0b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.731920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a20d4d-633b-4537-80df-ce7189dad237 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.736288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1817b40-31d6-4670-ae2d-1f76b72f3f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.736950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1817b40-31d6-4670-ae2d-1f76b72f3f55 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.737423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1817b40-31d6-4670-ae2d-1f76b72f3f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.737977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1817b40-31d6-4670-ae2d-1f76b72f3f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.741529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a1817b40-31d6-4670-ae2d-1f76b72f3f55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.743162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.743847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.744127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.744433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.745124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.747205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.801975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1817b40-31d6-4670-ae2d-1f76b72f3f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.804234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1817b40-31d6-4670-ae2d-1f76b72f3f55 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.814979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 949/1879] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:17.816759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d29d7-a50e-4dbc-ace6-c717d8e74f39 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.817153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d29d7-a50e-4dbc-ace6-c717d8e74f39 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.817815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d29d7-a50e-4dbc-ace6-c717d8e74f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.841165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 931/1880] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:17 2022] POST /identity/v3/users => generated 303 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:17.845716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:17.848785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.851834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.862538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4c0d29d7-a50e-4dbc-ace6-c717d8e74f39 None None] MFA Rules not processed for user `0adc45395f904f6b99aa16de3314c7ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:17.863771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4c0d29d7-a50e-4dbc-ace6-c717d8e74f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:17.867437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b0c4de-eff9-43da-b030-9789c876a39b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.873826 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.875213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.875613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.876098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] PATH_INFO: `/v3/projects/5f48f4d4cff440f18a7b617126e2be59` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.877845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f48f4d4cff440f18a7b617126e2be59)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.879971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:17.960951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 950/1881] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:17.960951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d29d7-a50e-4dbc-ace6-c717d8e74f39 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:17.976303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d29d7-a50e-4dbc-ace6-c717d8e74f39 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:17.981670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:17.982348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:17.982658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:17.983084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:17.983725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:17.985311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:18.002093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 951/1882] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:18.002093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:18.002093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:18.011886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f48f4d4cff440f18a7b617126e2be59', 'request_id': 'req-30350872-4380-48bf-a455-7a1aceec069b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.015538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394a142-aebf-43d1-9128-ce8a3100fa0d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:18.020621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f48f4d4cff440f18a7b617126e2be59', 'request_id': 'req-30350872-4380-48bf-a455-7a1aceec069b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.027365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f48f4d4cff440f18a7b617126e2be59', 'request_id': 'req-30350872-4380-48bf-a455-7a1aceec069b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.109101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] The token cache is being invalidate because project 5f48f4d4cff440f18a7b617126e2be59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:18.109101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.109861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.117059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 932/1883] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:17 2022] DELETE /identity/v3/projects/5f48f4d4cff440f18a7b617126e2be59 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:18.125913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:18.128374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:18.152084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:18.153406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:18.153406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:18.153585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:18.155478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:18.237698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30350872-4380-48bf-a455-7a1aceec069b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:18.253604 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:18.254310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:18.256617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:18.256617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:18.256617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:18.258354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:18.273818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 933/1884] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:18 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:18.273818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:18.275914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:18.308279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:18.309787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:18.311737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98c112-5b03-4c25-90c9-28b331c65bd4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:18.317019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:18.317951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:18.318355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:18.318763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] PATH_INFO: `/v3/projects/a66bb17f199c4e8a97d6fa1cd195721c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:18.320043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66bb17f199c4e8a97d6fa1cd195721c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:18.321774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 952/1885] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:18.322514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:18.322703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:18.324018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:18.341301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5722a1-efb3-49a6-8455-0c13a599c1a0 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:18.347089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:18.347978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:18.348274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:18.348541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] PATH_INFO: `/v3/users/3301290975f849b891e9224275dfea8e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:18.351379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3301290975f849b891e9224275dfea8e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:18.353010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:18.685971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3301290975f849b891e9224275dfea8e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.686666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3301290975f849b891e9224275dfea8e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.694738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3301290975f849b891e9224275dfea8e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.695745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66bb17f199c4e8a97d6fa1cd195721c', 'request_id': 'req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.702741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66bb17f199c4e8a97d6fa1cd195721c', 'request_id': 'req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.709371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66bb17f199c4e8a97d6fa1cd195721c', 'request_id': 'req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.710050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3301290975f849b891e9224275dfea8e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.711000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3301290975f849b891e9224275dfea8e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.807615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] The token cache is being invalidate because project a66bb17f199c4e8a97d6fa1cd195721c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:18.807615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.807615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:18.807615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 934/1886] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:18 2022] DELETE /identity/v3/projects/a66bb17f199c4e8a97d6fa1cd195721c => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:18.807615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:18.811176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:18.884465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f8ba1-651f-43b5-8b8d-c4d0115b320d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:18.889094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c067f-e232-4102-850f-e00a2ce768ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:18.890010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c067f-e232-4102-850f-e00a2ce768ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:18.890291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c067f-e232-4102-850f-e00a2ce768ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:18.890663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c067f-e232-4102-850f-e00a2ce768ea admin admin] PATH_INFO: `/v3/projects/190144ea59f04f9da3097e83ee7356e3/users/310583fa3a1147bb831f2f816668222b/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:18.912501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c067f-e232-4102-850f-e00a2ce768ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=190144ea59f04f9da3097e83ee7356e3, user_id=310583fa3a1147bb831f2f816668222b, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:18.913056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c067f-e232-4102-850f-e00a2ce768ea admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:18.915030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 953/1887] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:18 2022] DELETE /identity/v3/users/3301290975f849b891e9224275dfea8e => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:18.920725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:18.922263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:19.002935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 935/1888] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:18 2022] PUT /identity/v3/projects/190144ea59f04f9da3097e83ee7356e3/users/310583fa3a1147bb831f2f816668222b/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:19.007510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff645fc2-29af-4aaa-9275-2b922c72189b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:19.007797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff645fc2-29af-4aaa-9275-2b922c72189b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:19.008371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff645fc2-29af-4aaa-9275-2b922c72189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:19.015792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db4d73-d7f5-422d-bb82-d9e7a9ffd5f4 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:19.026084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ff645fc2-29af-4aaa-9275-2b922c72189b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:19.028320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ff645fc2-29af-4aaa-9275-2b922c72189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:19.078607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:19.079794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:19.080240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:19.080688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] PATH_INFO: `/v3/users/8275bb1dd2fa40b18826b1537f80429d` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:19.082086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8275bb1dd2fa40b18826b1537f80429d)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:19.085371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:19.097997 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 936/1889] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:19.108099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff645fc2-29af-4aaa-9275-2b922c72189b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:19.109640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ff645fc2-29af-4aaa-9275-2b922c72189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:19.188684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff645fc2-29af-4aaa-9275-2b922c72189b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:19.196834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:19.197688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:19.198061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:19.198409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:19.211163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:19.212677 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:19.223334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 937/1890] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:19.379283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8275bb1dd2fa40b18826b1537f80429d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:19.380033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8275bb1dd2fa40b18826b1537f80429d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:19.388218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8275bb1dd2fa40b18826b1537f80429d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:19.405723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8275bb1dd2fa40b18826b1537f80429d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:19.406474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8275bb1dd2fa40b18826b1537f80429d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:19.524924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:19.525818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 954/1891] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:18 2022] DELETE /identity/v3/users/8275bb1dd2fa40b18826b1537f80429d => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:19.526504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:19.553307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7151f4c5-0680-4428-b693-6e3c3e385c92 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:19.656023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:19.656973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:19.657256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:19.668241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] PATH_INFO: `/v3/projects/3d4e7fbb148943d599780f275c63faca` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:19.668241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4e7fbb148943d599780f275c63faca)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:19.668241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:19.725203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:19.883409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4e7fbb148943d599780f275c63faca', 'request_id': 'req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:19.892886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4e7fbb148943d599780f275c63faca', 'request_id': 'req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:19.902494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4e7fbb148943d599780f275c63faca', 'request_id': 'req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:19.957977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:19.961058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:19.985249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4924c9a4-b286-4a4e-930b-e6d7f6f2a0c0 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:20.015908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] The token cache is being invalidate because project 3d4e7fbb148943d599780f275c63faca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:20.016473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.018980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c55bff04-1acd-4dd3-bb4f-9e821331d6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.025408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 938/1892] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:19 2022] DELETE /identity/v3/projects/3d4e7fbb148943d599780f275c63faca => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:20.030112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f32b-b394-426a-971a-a047399e5a26 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.030564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f32b-b394-426a-971a-a047399e5a26 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.030714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924f32b-b394-426a-971a-a047399e5a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.052036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:20.053692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.054184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.054688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] PATH_INFO: `/v3/users/a16cc0b17b1a40a199a9b60eb5a188fc` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.056289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a16cc0b17b1a40a199a9b60eb5a188fc)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:20.057817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b924f32b-b394-426a-971a-a047399e5a26 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:20.058709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:20.059488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b924f32b-b394-426a-971a-a047399e5a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:20.068702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 939/1893] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:20.076513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0751-56a8-4cd5-9e67-5ff387cfca6a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.076794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0751-56a8-4cd5-9e67-5ff387cfca6a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.077080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996b0751-56a8-4cd5-9e67-5ff387cfca6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.097194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-996b0751-56a8-4cd5-9e67-5ff387cfca6a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:20.098415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-996b0751-56a8-4cd5-9e67-5ff387cfca6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:20.107518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 940/1894] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:20.111605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b0751-56a8-4cd5-9e67-5ff387cfca6a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:20.121886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996b0751-56a8-4cd5-9e67-5ff387cfca6a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:20.126918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:20.127705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.128383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.128383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.129271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:20.129739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:20.132539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:20.146766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 941/1895] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:48:20.155655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:20.157954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:20.176833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecd37f-cfb3-454b-8591-3c8e798b0458 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:20.182826 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:20.184120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.184242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.184527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] PATH_INFO: `/v3/projects/e9414e3fb27e449683d3849cec706fb7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.185956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9414e3fb27e449683d3849cec706fb7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:20.188244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:20.386668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a16cc0b17b1a40a199a9b60eb5a188fc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.388936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a16cc0b17b1a40a199a9b60eb5a188fc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.397481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9414e3fb27e449683d3849cec706fb7', 'request_id': 'req-eee2f919-3758-4586-b988-eda9758d9c2a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.400586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a16cc0b17b1a40a199a9b60eb5a188fc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.407474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9414e3fb27e449683d3849cec706fb7', 'request_id': 'req-eee2f919-3758-4586-b988-eda9758d9c2a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.415141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9414e3fb27e449683d3849cec706fb7', 'request_id': 'req-eee2f919-3758-4586-b988-eda9758d9c2a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.419896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a16cc0b17b1a40a199a9b60eb5a188fc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.421398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-38f7439b-8f38-423e-92bd-96be84b39c83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a16cc0b17b1a40a199a9b60eb5a188fc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.517234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] The token cache is being invalidate because project e9414e3fb27e449683d3849cec706fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:20.517532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.525417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:20.525417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 942/1896] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:20 2022] DELETE /identity/v3/projects/e9414e3fb27e449683d3849cec706fb7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:20.525417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:20.525417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:20.613498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 955/1897] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:19 2022] DELETE /identity/v3/users/a16cc0b17b1a40a199a9b60eb5a188fc => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:20.615866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07058e6a-df30-408c-ad5f-2589cd6654e3 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.616309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07058e6a-df30-408c-ad5f-2589cd6654e3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.616309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07058e6a-df30-408c-ad5f-2589cd6654e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.628314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2f919-3758-4586-b988-eda9758d9c2a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:20.638659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-07058e6a-df30-408c-ad5f-2589cd6654e3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:20.640015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-07058e6a-df30-408c-ad5f-2589cd6654e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:20.728652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 956/1898] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:20.730005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd46ce-d59e-4deb-8887-ae77962a0b24 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.730292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd46ce-d59e-4deb-8887-ae77962a0b24 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.730591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdd46ce-d59e-4deb-8887-ae77962a0b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.749794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4fdd46ce-d59e-4deb-8887-ae77962a0b24 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:20.751083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4fdd46ce-d59e-4deb-8887-ae77962a0b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:20.756516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35a3c-a679-4d8f-b08c-b464c65c937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:20.757186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35a3c-a679-4d8f-b08c-b464c65c937b admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.757461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35a3c-a679-4d8f-b08c-b464c65c937b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.757735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed35a3c-a679-4d8f-b08c-b464c65c937b admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.758417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35a3c-a679-4d8f-b08c-b464c65c937b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:20.760051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 957/1899] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:20.760514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed35a3c-a679-4d8f-b08c-b464c65c937b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:20.761455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a91625-9057-4286-99f8-0fed8cc7dccf None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.761979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a91625-9057-4286-99f8-0fed8cc7dccf None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.762348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a91625-9057-4286-99f8-0fed8cc7dccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.780859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-66a91625-9057-4286-99f8-0fed8cc7dccf None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:20.782073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-66a91625-9057-4286-99f8-0fed8cc7dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:20.790844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 958/1900] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:20.791776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a91625-9057-4286-99f8-0fed8cc7dccf None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:20.793045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-66a91625-9057-4286-99f8-0fed8cc7dccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:20.848776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a91625-9057-4286-99f8-0fed8cc7dccf None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:20.853210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d837a-c9ef-448a-a938-bcaf25301422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:20.853876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d837a-c9ef-448a-a938-bcaf25301422 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.854161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d837a-c9ef-448a-a938-bcaf25301422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.854437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291d837a-c9ef-448a-a938-bcaf25301422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.863982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d837a-c9ef-448a-a938-bcaf25301422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:20.866271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291d837a-c9ef-448a-a938-bcaf25301422 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:20.876088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 959/1901] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:20.876908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d837a-c9ef-448a-a938-bcaf25301422 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:20.885939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291d837a-c9ef-448a-a938-bcaf25301422 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:20.890512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:20.891201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:20.891480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:20.891768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:20.892567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:20.892870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:20.894448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:20.906708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 943/1902] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:20 2022] POST /identity/v3/projects => generated 387 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:20.907722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 960/1903] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:20.914871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35a3c-a679-4d8f-b08c-b464c65c937b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:20.915489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:20.926669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3c094-de77-4ef4-9b00-d6fdf919603e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.033393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c97f6b-9c4b-4c39-b5a6-64561b0aef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.033881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97f6b-9c4b-4c39-b5a6-64561b0aef30 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.034164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97f6b-9c4b-4c39-b5a6-64561b0aef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.037920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97f6b-9c4b-4c39-b5a6-64561b0aef30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.037920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c97f6b-9c4b-4c39-b5a6-64561b0aef30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.040034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c97f6b-9c4b-4c39-b5a6-64561b0aef30 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.050058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed35a3c-a679-4d8f-b08c-b464c65c937b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.056713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bc45-3a30-402d-8b45-b729f777b08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.058211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bc45-3a30-402d-8b45-b729f777b08b admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.058642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bc45-3a30-402d-8b45-b729f777b08b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.059019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb3bc45-3a30-402d-8b45-b729f777b08b admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.059975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3bc45-3a30-402d-8b45-b729f777b08b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.062390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb3bc45-3a30-402d-8b45-b729f777b08b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.212414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 961/1904] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:20 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:21.215106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337dae-c37e-4fe1-9d29-e4b825a27714 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.215536 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337dae-c37e-4fe1-9d29-e4b825a27714 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.215916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b337dae-c37e-4fe1-9d29-e4b825a27714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.241247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:21.248896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 944/1905] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:20 2022] POST /identity/v3/users => generated 294 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:21.248896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bc45-3a30-402d-8b45-b729f777b08b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.266708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-2b337dae-c37e-4fe1-9d29-e4b825a27714 None None] MFA Rules not processed for user `310583fa3a1147bb831f2f816668222b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:21.269139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2b337dae-c37e-4fe1-9d29-e4b825a27714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:21.277471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb3bc45-3a30-402d-8b45-b729f777b08b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.354815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a30c03-9249-4a2a-8c3a-872fb8711659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.355607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a30c03-9249-4a2a-8c3a-872fb8711659 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.355893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a30c03-9249-4a2a-8c3a-872fb8711659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.356188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a30c03-9249-4a2a-8c3a-872fb8711659 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.356958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a30c03-9249-4a2a-8c3a-872fb8711659 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.359118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a30c03-9249-4a2a-8c3a-872fb8711659 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.392680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 962/1906] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:21 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:21.394351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b337dae-c37e-4fe1-9d29-e4b825a27714 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.411088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b337dae-c37e-4fe1-9d29-e4b825a27714 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.419143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.419913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.420267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.420611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.421415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.423866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.435304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 963/1907] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:21.436103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.437853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:21.452117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af491-f9b0-475e-8a34-8813885bc623 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.457291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.457972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.458256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.459077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.459939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.461782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.516650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 945/1908] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:21 2022] POST /identity/v3/users => generated 284 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:21.517561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a30c03-9249-4a2a-8c3a-872fb8711659 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.528315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a30c03-9249-4a2a-8c3a-872fb8711659 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.533110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1aa35-06ac-4180-9808-6fada4afb9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.533774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aa35-06ac-4180-9808-6fada4afb9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.534058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aa35-06ac-4180-9808-6fada4afb9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.534336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1aa35-06ac-4180-9808-6fada4afb9f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.535095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1aa35-06ac-4180-9808-6fada4afb9f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.537069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1aa35-06ac-4180-9808-6fada4afb9f2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.547316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 946/1909] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:21.548259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1aa35-06ac-4180-9808-6fada4afb9f2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.558201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1aa35-06ac-4180-9808-6fada4afb9f2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.562996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8329559-e7f5-4e62-85a2-bec666c40ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.563660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8329559-e7f5-4e62-85a2-bec666c40ada admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.563944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8329559-e7f5-4e62-85a2-bec666c40ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.564223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8329559-e7f5-4e62-85a2-bec666c40ada admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.564946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8329559-e7f5-4e62-85a2-bec666c40ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.566555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8329559-e7f5-4e62-85a2-bec666c40ada admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.581511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 947/1910] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:21.581511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8329559-e7f5-4e62-85a2-bec666c40ada admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.591864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8329559-e7f5-4e62-85a2-bec666c40ada admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.606844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 964/1911] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:21 2022] POST /identity/v3/projects => generated 405 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:21.618845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ab3c3-72d5-465c-8409-aa83e97d1ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.619526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.619900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab3c3-72d5-465c-8409-aa83e97d1ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.619900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab3c3-72d5-465c-8409-aa83e97d1ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.619900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ab3c3-72d5-465c-8409-aa83e97d1ee0 admin admin] PATH_INFO: `/v3/projects/5173457c932446f5a403a08c2d34f812/users/382b7c50290144b284446366212c35c5/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.620371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:21.628270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ab3c3-72d5-465c-8409-aa83e97d1ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5173457c932446f5a403a08c2d34f812, user_id=382b7c50290144b284446366212c35c5, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.635413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ab3c3-72d5-465c-8409-aa83e97d1ee0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.693788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7555cba-0b45-4b7f-9351-f9a6ddb68319 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.698535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.699408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.699686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.699960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] PATH_INFO: `/v3/projects/3283799d5e4b44b79508e9292ec7c10c` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.701195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3283799d5e4b44b79508e9292ec7c10c)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.703183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.745051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 948/1912] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:21 2022] PUT /identity/v3/projects/5173457c932446f5a403a08c2d34f812/users/382b7c50290144b284446366212c35c5/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:21.745051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ab3c3-72d5-465c-8409-aa83e97d1ee0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.808946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ab3c3-72d5-465c-8409-aa83e97d1ee0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.813617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0463d-ac68-401c-a0c5-bcafb0ee1376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.814299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0463d-ac68-401c-a0c5-bcafb0ee1376 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.814633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0463d-ac68-401c-a0c5-bcafb0ee1376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.815011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0463d-ac68-401c-a0c5-bcafb0ee1376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.815883 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0463d-ac68-401c-a0c5-bcafb0ee1376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.817503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0463d-ac68-401c-a0c5-bcafb0ee1376 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.828766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 949/1913] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:21.829786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0463d-ac68-401c-a0c5-bcafb0ee1376 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:21.841631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0463d-ac68-401c-a0c5-bcafb0ee1376 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:21.846661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d8fa3-9c29-467d-95e7-09070e82cefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:21.847437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d8fa3-9c29-467d-95e7-09070e82cefb admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:21.847785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d8fa3-9c29-467d-95e7-09070e82cefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:21.848134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d8fa3-9c29-467d-95e7-09070e82cefb admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:21.848832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d8fa3-9c29-467d-95e7-09070e82cefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:21.850775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d8fa3-9c29-467d-95e7-09070e82cefb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:21.892090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3283799d5e4b44b79508e9292ec7c10c', 'request_id': 'req-4b45fac5-0170-470f-8c62-f98d1965b045'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:21.900250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3283799d5e4b44b79508e9292ec7c10c', 'request_id': 'req-4b45fac5-0170-470f-8c62-f98d1965b045'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.005259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 950/1914] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:21 2022] POST /identity/v3/users => generated 309 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:22.005259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69442ef6-ae1f-4bef-9619-7fba6556e405 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.005259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69442ef6-ae1f-4bef-9619-7fba6556e405 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.005259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69442ef6-ae1f-4bef-9619-7fba6556e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.031022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-69442ef6-ae1f-4bef-9619-7fba6556e405 None None] MFA Rules not processed for user `382b7c50290144b284446366212c35c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:22.032227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-69442ef6-ae1f-4bef-9619-7fba6556e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:22.071280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3283799d5e4b44b79508e9292ec7c10c', 'request_id': 'req-4b45fac5-0170-470f-8c62-f98d1965b045'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.091423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] The token cache is being invalidate because project 3283799d5e4b44b79508e9292ec7c10c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:22.091882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.093044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.095742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 965/1915] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:21 2022] DELETE /identity/v3/projects/3283799d5e4b44b79508e9292ec7c10c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:22.096859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:22.099262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:22.102305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 951/1916] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:22.103402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69442ef6-ae1f-4bef-9619-7fba6556e405 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:22.183757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45fac5-0170-470f-8c62-f98d1965b045 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:22.184079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69442ef6-ae1f-4bef-9619-7fba6556e405 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:22.189082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:22.189540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:22.194661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.194795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.194900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.194986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.195065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] PATH_INFO: `/v3/projects/371cee4cb3654a84be4b2e5cf3f7d295/users/c7eeecd2d826456f9f1734faa3e5042e/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.195155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.195155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:22.195155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:22.206031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 952/1917] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:22.207561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:22.210133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=371cee4cb3654a84be4b2e5cf3f7d295, user_id=c7eeecd2d826456f9f1734faa3e5042e, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:22.213717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:22.215374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:22.226268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:22.230321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee039e-987f-4071-afe7-6fa1ac9cbb18 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:22.235063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:22.235950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.236229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.236499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] PATH_INFO: `/v3/users/0adc45395f904f6b99aa16de3314c7ab` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.237703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adc45395f904f6b99aa16de3314c7ab)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:22.240277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:22.332790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 966/1918] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:22 2022] PUT /identity/v3/projects/371cee4cb3654a84be4b2e5cf3f7d295/users/c7eeecd2d826456f9f1734faa3e5042e/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:22.334288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:22.336033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:22.402845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7817d2-1632-48de-97e2-d0c62cf84136 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:22.407552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:22.408218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.408495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.408762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.409487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:22.412259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:22.519718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adc45395f904f6b99aa16de3314c7ab'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.520738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adc45395f904f6b99aa16de3314c7ab'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.522229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adc45395f904f6b99aa16de3314c7ab'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.538956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adc45395f904f6b99aa16de3314c7ab'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.549799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6b60ad02-9fb4-42cf-9a7a-bbca83af905f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adc45395f904f6b99aa16de3314c7ab'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:22.569288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 967/1919] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:22 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:22.570097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:22.571771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:22.636854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c0ff0-6017-4230-8a21-9c736dda451b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:22.641563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:22.642458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.642785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.643058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] PATH_INFO: `/v3/projects/76d2b58574774fad9c9a46db86f41668/users/00e763b7b9254fb5b0b5f3e7a3fa563b/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.653972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 953/1920] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:22 2022] DELETE /identity/v3/users/0adc45395f904f6b99aa16de3314c7ab => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:22.655240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884263-1bd9-4651-b5df-96af7274cded None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.660204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d2b58574774fad9c9a46db86f41668, user_id=00e763b7b9254fb5b0b5f3e7a3fa563b, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:22.664254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:22.665830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884263-1bd9-4651-b5df-96af7274cded None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.672023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05884263-1bd9-4651-b5df-96af7274cded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.699198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-05884263-1bd9-4651-b5df-96af7274cded None None] MFA Rules not processed for user `c7eeecd2d826456f9f1734faa3e5042e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:22.700590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-05884263-1bd9-4651-b5df-96af7274cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:22.775400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 954/1921] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:22.775400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05884263-1bd9-4651-b5df-96af7274cded None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:22.775400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-05884263-1bd9-4651-b5df-96af7274cded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:22.778338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 968/1922] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:22 2022] PUT /identity/v3/projects/76d2b58574774fad9c9a46db86f41668/users/00e763b7b9254fb5b0b5f3e7a3fa563b/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:22.783034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:22.785199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:22.856038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05884263-1bd9-4651-b5df-96af7274cded None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:22.878096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c78f9f-046d-4f31-aef2-92be3d55ed5c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:22.885091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0904093-6d2e-4300-99c1-5172380eb938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:22.886108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0904093-6d2e-4300-99c1-5172380eb938 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.886108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0904093-6d2e-4300-99c1-5172380eb938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.890779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0904093-6d2e-4300-99c1-5172380eb938 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.890779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0904093-6d2e-4300-99c1-5172380eb938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:22.890779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0904093-6d2e-4300-99c1-5172380eb938 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:22.928284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e81f5d-dfcc-4f88-b93e-3b32ecb02f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:22.929208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81f5d-dfcc-4f88-b93e-3b32ecb02f5a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:22.929495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81f5d-dfcc-4f88-b93e-3b32ecb02f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:22.929840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81f5d-dfcc-4f88-b93e-3b32ecb02f5a admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:22.930572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e81f5d-dfcc-4f88-b93e-3b32ecb02f5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:22.932510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e81f5d-dfcc-4f88-b93e-3b32ecb02f5a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.037564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 969/1923] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:22 2022] POST /identity/v3/projects => generated 365 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:23.037564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0904093-6d2e-4300-99c1-5172380eb938 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.055126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 955/1924] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:22 2022] POST /identity/v3/users => generated 300 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:23.056042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e81f5d-dfcc-4f88-b93e-3b32ecb02f5a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.074191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e81f5d-dfcc-4f88-b93e-3b32ecb02f5a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.121959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0904093-6d2e-4300-99c1-5172380eb938 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.126810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35562d5c-2f85-4f1e-a6d6-52f220d00826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.127484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35562d5c-2f85-4f1e-a6d6-52f220d00826 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.127765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35562d5c-2f85-4f1e-a6d6-52f220d00826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.128043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35562d5c-2f85-4f1e-a6d6-52f220d00826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.128762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35562d5c-2f85-4f1e-a6d6-52f220d00826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.130365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35562d5c-2f85-4f1e-a6d6-52f220d00826 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.133204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.133948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.134235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.134511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.135761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.137815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.141752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 970/1925] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:23.142708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35562d5c-2f85-4f1e-a6d6-52f220d00826 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.153172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35562d5c-2f85-4f1e-a6d6-52f220d00826 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.157964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fba5b-0cc4-467d-8d8e-60f94baf8f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.158587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fba5b-0cc4-467d-8d8e-60f94baf8f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.158870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fba5b-0cc4-467d-8d8e-60f94baf8f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.159145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fba5b-0cc4-467d-8d8e-60f94baf8f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.159857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fba5b-0cc4-467d-8d8e-60f94baf8f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.162171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fba5b-0cc4-467d-8d8e-60f94baf8f49 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.172488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 971/1926] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:23.173242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fba5b-0cc4-467d-8d8e-60f94baf8f49 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.182697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fba5b-0cc4-467d-8d8e-60f94baf8f49 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.187256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad53b7e-5707-4222-a367-df103eaa3ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.188489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad53b7e-5707-4222-a367-df103eaa3ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.188803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad53b7e-5707-4222-a367-df103eaa3ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.189077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad53b7e-5707-4222-a367-df103eaa3ab5 admin admin] PATH_INFO: `/v3/projects/76d2b58574774fad9c9a46db86f41668/users/00e763b7b9254fb5b0b5f3e7a3fa563b/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.191062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad53b7e-5707-4222-a367-df103eaa3ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d2b58574774fad9c9a46db86f41668, user_id=00e763b7b9254fb5b0b5f3e7a3fa563b, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.194239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad53b7e-5707-4222-a367-df103eaa3ab5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.204566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 972/1927] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:23 2022] PUT /identity/v3/projects/76d2b58574774fad9c9a46db86f41668/users/00e763b7b9254fb5b0b5f3e7a3fa563b/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:23.205399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad53b7e-5707-4222-a367-df103eaa3ab5 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.280367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad53b7e-5707-4222-a367-df103eaa3ab5 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.285850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437a407-2bef-44e7-a713-2f0dd99d1e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.287758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437a407-2bef-44e7-a713-2f0dd99d1e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.288104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437a407-2bef-44e7-a713-2f0dd99d1e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.288437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437a407-2bef-44e7-a713-2f0dd99d1e3a admin admin] PATH_INFO: `/v3/projects/590abcb282d24f64b66a818eaff08787/users/a2a29211b1514ac697f231838e083302/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.289912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 956/1928] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:23 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:23.290772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.292673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:23.304611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437a407-2bef-44e7-a713-2f0dd99d1e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=590abcb282d24f64b66a818eaff08787, user_id=a2a29211b1514ac697f231838e083302, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.305574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd98c08-a9e3-4654-a9ae-cb2dac01e5ba admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.307421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437a407-2bef-44e7-a713-2f0dd99d1e3a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.310390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.311310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.311579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.311852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] PATH_INFO: `/v3/projects/8df5a272438243fab52526418bfdfaa0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.313036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df5a272438243fab52526418bfdfaa0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.315033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.490179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 973/1929] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:23 2022] PUT /identity/v3/projects/590abcb282d24f64b66a818eaff08787/users/a2a29211b1514ac697f231838e083302/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:23.491509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437a407-2bef-44e7-a713-2f0dd99d1e3a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.502232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df5a272438243fab52526418bfdfaa0', 'request_id': 'req-8c8755b1-17db-4144-98ed-0303c8e384c1'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:23.511416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df5a272438243fab52526418bfdfaa0', 'request_id': 'req-8c8755b1-17db-4144-98ed-0303c8e384c1'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:23.517312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df5a272438243fab52526418bfdfaa0', 'request_id': 'req-8c8755b1-17db-4144-98ed-0303c8e384c1'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:23.563338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437a407-2bef-44e7-a713-2f0dd99d1e3a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.595642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] The token cache is being invalidate because project 8df5a272438243fab52526418bfdfaa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:23.596182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:23.597801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:23.601134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 957/1930] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:23 2022] DELETE /identity/v3/projects/8df5a272438243fab52526418bfdfaa0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:23.601488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.602894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:23.635082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda4814-649d-43a5-8e46-0db72b9b7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.635761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4814-649d-43a5-8e46-0db72b9b7be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.636044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4814-649d-43a5-8e46-0db72b9b7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.636317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda4814-649d-43a5-8e46-0db72b9b7be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.637043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4814-649d-43a5-8e46-0db72b9b7be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.638647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda4814-649d-43a5-8e46-0db72b9b7be0 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.649673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 974/1931] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:23.649673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81152e-6adc-4ddc-9bc8-fd1923ac495d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.649673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81152e-6adc-4ddc-9bc8-fd1923ac495d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.649673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81152e-6adc-4ddc-9bc8-fd1923ac495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.672151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5f81152e-6adc-4ddc-9bc8-fd1923ac495d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:23.673407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5f81152e-6adc-4ddc-9bc8-fd1923ac495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:23.679990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8755b1-17db-4144-98ed-0303c8e384c1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.684494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 975/1932] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:23.684494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81152e-6adc-4ddc-9bc8-fd1923ac495d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.692511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5f81152e-6adc-4ddc-9bc8-fd1923ac495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:23.692818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8e5ca-30c6-48ab-9089-349f6b8b8936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.696667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e5ca-30c6-48ab-9089-349f6b8b8936 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.696667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e5ca-30c6-48ab-9089-349f6b8b8936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.696667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8e5ca-30c6-48ab-9089-349f6b8b8936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.698111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8e5ca-30c6-48ab-9089-349f6b8b8936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.699432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8e5ca-30c6-48ab-9089-349f6b8b8936 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.710342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81152e-6adc-4ddc-9bc8-fd1923ac495d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.714094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 958/1933] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:23.714094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74637-47d3-42b7-a050-084ba7de0165 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.714094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74637-47d3-42b7-a050-084ba7de0165 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.714094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c74637-47d3-42b7-a050-084ba7de0165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.716451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6fa6d-bb4d-485b-83ee-bb2fabe8d68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.717405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6fa6d-bb4d-485b-83ee-bb2fabe8d68e admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.717682 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6fa6d-bb4d-485b-83ee-bb2fabe8d68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.717968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6fa6d-bb4d-485b-83ee-bb2fabe8d68e admin admin] PATH_INFO: `/v3/projects/b8afcd3ac1ce428983de300044e4395c/users/031b2bbbbd734fefb0713bf63047db2b/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.733809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-89c74637-47d3-42b7-a050-084ba7de0165 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:23.734006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6fa6d-bb4d-485b-83ee-bb2fabe8d68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8afcd3ac1ce428983de300044e4395c, user_id=031b2bbbbd734fefb0713bf63047db2b, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.734795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-89c74637-47d3-42b7-a050-084ba7de0165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:23.736393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6fa6d-bb4d-485b-83ee-bb2fabe8d68e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.744095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 959/1934] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:23.747887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c74637-47d3-42b7-a050-084ba7de0165 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.758640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c74637-47d3-42b7-a050-084ba7de0165 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.763400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab84e9-669f-483f-bb8c-d2af85fd6503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.764298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab84e9-669f-483f-bb8c-d2af85fd6503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.764579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab84e9-669f-483f-bb8c-d2af85fd6503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.764857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab84e9-669f-483f-bb8c-d2af85fd6503 admin admin] PATH_INFO: `/v3/projects/590abcb282d24f64b66a818eaff08787/users/a2a29211b1514ac697f231838e083302/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.766900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab84e9-669f-483f-bb8c-d2af85fd6503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=590abcb282d24f64b66a818eaff08787, user_id=a2a29211b1514ac697f231838e083302, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.769533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab84e9-669f-483f-bb8c-d2af85fd6503 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.780481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 960/1935] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:23 2022] PUT /identity/v3/projects/590abcb282d24f64b66a818eaff08787/users/a2a29211b1514ac697f231838e083302/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:23.781460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab84e9-669f-483f-bb8c-d2af85fd6503 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.812540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 976/1936] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:23 2022] PUT /identity/v3/projects/b8afcd3ac1ce428983de300044e4395c/users/031b2bbbbd734fefb0713bf63047db2b/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:23.813945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd59b-037c-4172-aaf7-4b35bed9fab1 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.814230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd59b-037c-4172-aaf7-4b35bed9fab1 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.814508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3bd59b-037c-4172-aaf7-4b35bed9fab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.845143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4c3bd59b-037c-4172-aaf7-4b35bed9fab1 None None] MFA Rules not processed for user `a2a29211b1514ac697f231838e083302`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:23.846555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4c3bd59b-037c-4172-aaf7-4b35bed9fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:23.852843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab84e9-669f-483f-bb8c-d2af85fd6503 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.924936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.925736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.926090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.926446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.927406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:23.928268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.929966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.938723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 977/1937] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:23.938723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bd59b-037c-4172-aaf7-4b35bed9fab1 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.943396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 961/1938] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:23.947770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.954406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3bd59b-037c-4172-aaf7-4b35bed9fab1 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.959905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c261769d-67b0-4031-8a0b-f93c1871e6d4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:23.961458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.962162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.962619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.963034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.963949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.965553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.967906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668640f8-b2ad-485b-b514-5b45c3705876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:23.968616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668640f8-b2ad-485b-b514-5b45c3705876 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:23.968900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668640f8-b2ad-485b-b514-5b45c3705876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:23.969176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668640f8-b2ad-485b-b514-5b45c3705876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:23.970220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668640f8-b2ad-485b-b514-5b45c3705876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:23.976844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668640f8-b2ad-485b-b514-5b45c3705876 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:23.981910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 978/1939] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:23.984456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:23.984623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:23.985933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:24.049865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f0f50-9645-4373-8dbd-abeb2ccab234 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.057011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed987ce0-1ac2-40c9-9fef-832fd60007c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.057677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed987ce0-1ac2-40c9-9fef-832fd60007c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.057960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed987ce0-1ac2-40c9-9fef-832fd60007c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.058234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed987ce0-1ac2-40c9-9fef-832fd60007c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.067817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed987ce0-1ac2-40c9-9fef-832fd60007c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.069275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed987ce0-1ac2-40c9-9fef-832fd60007c4 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.078877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 979/1940] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:24.079712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed987ce0-1ac2-40c9-9fef-832fd60007c4 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.090338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed987ce0-1ac2-40c9-9fef-832fd60007c4 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.097961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d065d-62df-4504-a145-69b073ba95ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.099877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d065d-62df-4504-a145-69b073ba95ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.100273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d065d-62df-4504-a145-69b073ba95ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.100655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d065d-62df-4504-a145-69b073ba95ed admin admin] PATH_INFO: `/v3/projects/b8afcd3ac1ce428983de300044e4395c/users/031b2bbbbd734fefb0713bf63047db2b/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.102896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d065d-62df-4504-a145-69b073ba95ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8afcd3ac1ce428983de300044e4395c, user_id=031b2bbbbd734fefb0713bf63047db2b, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.105690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d065d-62df-4504-a145-69b073ba95ed admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.119585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 962/1941] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:23 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:24.119883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:24.120978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668640f8-b2ad-485b-b514-5b45c3705876 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.123074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 980/1942] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:24 2022] PUT /identity/v3/projects/b8afcd3ac1ce428983de300044e4395c/users/031b2bbbbd734fefb0713bf63047db2b/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:24.134737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75287ca-63f0-4e86-bfa9-3ff6216ae224 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.135030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75287ca-63f0-4e86-bfa9-3ff6216ae224 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.135313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75287ca-63f0-4e86-bfa9-3ff6216ae224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.207703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f75287ca-63f0-4e86-bfa9-3ff6216ae224 None None] MFA Rules not processed for user `031b2bbbbd734fefb0713bf63047db2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:24.210649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f75287ca-63f0-4e86-bfa9-3ff6216ae224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:24.217015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668640f8-b2ad-485b-b514-5b45c3705876 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.227556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927b46d-94cd-4dd6-bd59-cb220d7fe056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.227556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927b46d-94cd-4dd6-bd59-cb220d7fe056 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.227556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927b46d-94cd-4dd6-bd59-cb220d7fe056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.227556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c927b46d-94cd-4dd6-bd59-cb220d7fe056 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.228021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927b46d-94cd-4dd6-bd59-cb220d7fe056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.231791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c927b46d-94cd-4dd6-bd59-cb220d7fe056 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.330465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 981/1943] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:24.331303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75287ca-63f0-4e86-bfa9-3ff6216ae224 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.344762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75287ca-63f0-4e86-bfa9-3ff6216ae224 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.351516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.352995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.352995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.352995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] PATH_INFO: `/v3/users/382b7c50290144b284446366212c35c5` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.357340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=382b7c50290144b284446366212c35c5)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.359600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.370772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 963/1944] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:24 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:24.370772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927b46d-94cd-4dd6-bd59-cb220d7fe056 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.428121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c927b46d-94cd-4dd6-bd59-cb220d7fe056 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.431791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5fbbf-ff97-4ade-9271-82a21e7bdf40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.432444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5fbbf-ff97-4ade-9271-82a21e7bdf40 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.432726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5fbbf-ff97-4ade-9271-82a21e7bdf40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.433004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5fbbf-ff97-4ade-9271-82a21e7bdf40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.442220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5fbbf-ff97-4ade-9271-82a21e7bdf40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.444302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5fbbf-ff97-4ade-9271-82a21e7bdf40 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.454446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 964/1945] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:24.455120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5fbbf-ff97-4ade-9271-82a21e7bdf40 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.468422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5fbbf-ff97-4ade-9271-82a21e7bdf40 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.473854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbd90a-9fee-4f08-9b69-f9c38ddbd6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.474044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbd90a-9fee-4f08-9b69-f9c38ddbd6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.475103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbd90a-9fee-4f08-9b69-f9c38ddbd6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.475960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbd90a-9fee-4f08-9b69-f9c38ddbd6c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.476851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbd90a-9fee-4f08-9b69-f9c38ddbd6c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.478305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbd90a-9fee-4f08-9b69-f9c38ddbd6c0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.492831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 965/1946] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:24.494060 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbd90a-9fee-4f08-9b69-f9c38ddbd6c0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.504414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbd90a-9fee-4f08-9b69-f9c38ddbd6c0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.510481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446901-9798-4f08-ada1-5557f1ea9baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.511268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446901-9798-4f08-ada1-5557f1ea9baa admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.511473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446901-9798-4f08-ada1-5557f1ea9baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.511723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8446901-9798-4f08-ada1-5557f1ea9baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.512453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8446901-9798-4f08-ada1-5557f1ea9baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.514103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8446901-9798-4f08-ada1-5557f1ea9baa admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.528030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 966/1947] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:24.529056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446901-9798-4f08-ada1-5557f1ea9baa admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.539858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8446901-9798-4f08-ada1-5557f1ea9baa admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.544456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb7d53-3adf-4982-b12f-5616b6e20f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.545341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7d53-3adf-4982-b12f-5616b6e20f0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.545626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7d53-3adf-4982-b12f-5616b6e20f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.545903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7d53-3adf-4982-b12f-5616b6e20f0c admin admin] PATH_INFO: `/v3/projects/d9463aa7fbae4e57ba8ad0665d02cde9/users/83593bb36f53415185e8743a6e9e3c5e/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.563300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb7d53-3adf-4982-b12f-5616b6e20f0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9463aa7fbae4e57ba8ad0665d02cde9, user_id=83593bb36f53415185e8743a6e9e3c5e, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:24.565970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb7d53-3adf-4982-b12f-5616b6e20f0c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:24.572264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '382b7c50290144b284446366212c35c5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:24.573066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '382b7c50290144b284446366212c35c5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:24.582421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '382b7c50290144b284446366212c35c5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:24.594816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '382b7c50290144b284446366212c35c5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:24.595532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-343648f1-1ebc-4611-a192-9f30c19e85d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '382b7c50290144b284446366212c35c5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:24.667190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 967/1948] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:24 2022] PUT /identity/v3/projects/d9463aa7fbae4e57ba8ad0665d02cde9/users/83593bb36f53415185e8743a6e9e3c5e/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:24.686093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e87eb7-8411-4d80-8d61-cc2d43fce94c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.686398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e87eb7-8411-4d80-8d61-cc2d43fce94c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.686707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e87eb7-8411-4d80-8d61-cc2d43fce94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.715391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 982/1949] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:24 2022] DELETE /identity/v3/users/382b7c50290144b284446366212c35c5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:24.717242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050bd2-68e9-49cc-b083-3b90152c4510 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.717536 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050bd2-68e9-49cc-b083-3b90152c4510 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.717819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab050bd2-68e9-49cc-b083-3b90152c4510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.745464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ab050bd2-68e9-49cc-b083-3b90152c4510 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:24.745788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a0e87eb7-8411-4d80-8d61-cc2d43fce94c None None] MFA Rules not processed for user `83593bb36f53415185e8743a6e9e3c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:24.747060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ab050bd2-68e9-49cc-b083-3b90152c4510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:24.751121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a0e87eb7-8411-4d80-8d61-cc2d43fce94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:24.854959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 968/1950] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:24.857019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e87eb7-8411-4d80-8d61-cc2d43fce94c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:24.858845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a0e87eb7-8411-4d80-8d61-cc2d43fce94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:24.879693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 983/1951] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:24.881246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509b36-1341-47de-8ad9-46dbd36a95e3 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.881545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509b36-1341-47de-8ad9-46dbd36a95e3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.881811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb509b36-1341-47de-8ad9-46dbd36a95e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.926891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-cb509b36-1341-47de-8ad9-46dbd36a95e3 None None] MFA Rules not processed for user `00e763b7b9254fb5b0b5f3e7a3fa563b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:24.929536 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cb509b36-1341-47de-8ad9-46dbd36a95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:24.939647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e87eb7-8411-4d80-8d61-cc2d43fce94c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:24.945395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:24.946359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:24.946760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:24.947192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:24.949684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:25.017477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 984/1952] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:24 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:25.018348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509b36-1341-47de-8ad9-46dbd36a95e3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:25.019934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cb509b36-1341-47de-8ad9-46dbd36a95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:25.043780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:25.045381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:25.060471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 969/1953] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:25.061392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:25.063781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:25.086845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28661c-7875-4072-9f4f-107c0286b393 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:25.101182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:25.101978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:25.102339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:25.103793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:25.113585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb509b36-1341-47de-8ad9-46dbd36a95e3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:25.116236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:25.117788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:25.118405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713bbbe-f11a-4b72-b603-e4ec57a264f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:25.119231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713bbbe-f11a-4b72-b603-e4ec57a264f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:25.119513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713bbbe-f11a-4b72-b603-e4ec57a264f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:25.119784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713bbbe-f11a-4b72-b603-e4ec57a264f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:25.128343 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 970/1954] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:25.135173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713bbbe-f11a-4b72-b603-e4ec57a264f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:25.137231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713bbbe-f11a-4b72-b603-e4ec57a264f4 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:25.149429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:25.151225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:25.163139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 985/1955] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:25.166923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b362789-8573-4979-b82f-3969c3727cf3 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:25.176430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:25.176430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:25.176430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:25.176430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] PATH_INFO: `/v3/users/83593bb36f53415185e8743a6e9e3c5e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:25.176783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=83593bb36f53415185e8743a6e9e3c5e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:25.177995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:25.524500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83593bb36f53415185e8743a6e9e3c5e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:25.524978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83593bb36f53415185e8743a6e9e3c5e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:25.525543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83593bb36f53415185e8743a6e9e3c5e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:25.541895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83593bb36f53415185e8743a6e9e3c5e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:25.564558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83593bb36f53415185e8743a6e9e3c5e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:25.693819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 971/1956] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:25 2022] DELETE /identity/v3/users/83593bb36f53415185e8743a6e9e3c5e => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:25.697785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502549-44e9-430e-8d2d-d5cacc26316b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:25.698404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502549-44e9-430e-8d2d-d5cacc26316b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:25.699429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502549-44e9-430e-8d2d-d5cacc26316b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:25.717555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:25.723566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9e502549-44e9-430e-8d2d-d5cacc26316b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:25.724944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9e502549-44e9-430e-8d2d-d5cacc26316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:25.799445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 986/1957] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:25.799567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:25.799567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:25.810891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502549-44e9-430e-8d2d-d5cacc26316b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:25.812543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9e502549-44e9-430e-8d2d-d5cacc26316b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:25.820199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a311b-6240-4d65-8a12-156e1d1c74ac admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:25.825474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:25.826539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:25.826927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:25.827308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] PATH_INFO: `/v3/projects/5173457c932446f5a403a08c2d34f812` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:25.828649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5173457c932446f5a403a08c2d34f812)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:25.831126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:25.840654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:25.901416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502549-44e9-430e-8d2d-d5cacc26316b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:25.901631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f395b-e182-4fac-95d9-b39ff644a726 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:25.906418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f395b-e182-4fac-95d9-b39ff644a726 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:25.906418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f395b-e182-4fac-95d9-b39ff644a726 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:25.906418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f395b-e182-4fac-95d9-b39ff644a726 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:25.914310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f395b-e182-4fac-95d9-b39ff644a726 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:25.915768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f395b-e182-4fac-95d9-b39ff644a726 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:25.925823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 987/1958] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:25.952143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5173457c932446f5a403a08c2d34f812', 'request_id': 'req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:25.960828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5173457c932446f5a403a08c2d34f812', 'request_id': 'req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:25.967560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5173457c932446f5a403a08c2d34f812', 'request_id': 'req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.059226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] The token cache is being invalidate because project 5173457c932446f5a403a08c2d34f812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:26.059522 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.060189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ed5fc0e-d526-4ff3-b72e-cd7b9f7ee631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.062115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 972/1959] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:25 2022] DELETE /identity/v3/projects/5173457c932446f5a403a08c2d34f812 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:26.065857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f395b-e182-4fac-95d9-b39ff644a726 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:26.081471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f395b-e182-4fac-95d9-b39ff644a726 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:26.108379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483602-bc65-4042-abec-9eb70153242e None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:26.108379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483602-bc65-4042-abec-9eb70153242e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:26.108595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33483602-bc65-4042-abec-9eb70153242e None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:26.111242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 973/1960] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:48:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:48:26.149352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72f2d-6810-45a2-8b96-b4f4a03ea3a7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:26.150114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72f2d-6810-45a2-8b96-b4f4a03ea3a7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:26.150114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba72f2d-6810-45a2-8b96-b4f4a03ea3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:26.154948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:26.156425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:26.156703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:26.156973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] PATH_INFO: `/v3/users/a2a29211b1514ac697f231838e083302` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:26.158233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a29211b1514ac697f231838e083302)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:26.160468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:26.172950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-eba72f2d-6810-45a2-8b96-b4f4a03ea3a7 None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:26.174273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eba72f2d-6810-45a2-8b96-b4f4a03ea3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:26.250632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 974/1961] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:26.270374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba72f2d-6810-45a2-8b96-b4f4a03ea3a7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:26.272584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-eba72f2d-6810-45a2-8b96-b4f4a03ea3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:26.294133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba72f2d-6810-45a2-8b96-b4f4a03ea3a7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:26.300819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:26.301489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:26.301765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:26.302036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:26.314967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:26.316769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:26.329074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 975/1962] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:26.427982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a29211b1514ac697f231838e083302'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.429253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a29211b1514ac697f231838e083302'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.436223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a29211b1514ac697f231838e083302'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.449055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a29211b1514ac697f231838e083302'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.449770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-142c6290-2afb-4326-a472-ecbd63b8efdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a29211b1514ac697f231838e083302'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.527901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:26.527901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:26.542454 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd2e1a-08f2-4cad-a793-875683e0af9c service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:26.548748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:26.549696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:26.549996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:26.550182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] PATH_INFO: `/v3/projects/d9463aa7fbae4e57ba8ad0665d02cde9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:26.551446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9463aa7fbae4e57ba8ad0665d02cde9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:26.554111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:26.556861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 988/1963] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:26 2022] DELETE /identity/v3/users/a2a29211b1514ac697f231838e083302 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:26.680797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9463aa7fbae4e57ba8ad0665d02cde9', 'request_id': 'req-9dc0ef65-c641-4f71-ad51-a626afb076ce'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.687276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9463aa7fbae4e57ba8ad0665d02cde9', 'request_id': 'req-9dc0ef65-c641-4f71-ad51-a626afb076ce'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.697083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9463aa7fbae4e57ba8ad0665d02cde9', 'request_id': 'req-9dc0ef65-c641-4f71-ad51-a626afb076ce'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.863317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] The token cache is being invalidate because project d9463aa7fbae4e57ba8ad0665d02cde9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:26.868617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.868617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:26.868617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 976/1964] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:26 2022] DELETE /identity/v3/projects/d9463aa7fbae4e57ba8ad0665d02cde9 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:26.872461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe54b-3b9f-4fb5-a197-c5c92c1aa0c2 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:26.872925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe54b-3b9f-4fb5-a197-c5c92c1aa0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:26.873012 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe54b-3b9f-4fb5-a197-c5c92c1aa0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:26.900322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e85fe54b-3b9f-4fb5-a197-c5c92c1aa0c2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:26.901570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e85fe54b-3b9f-4fb5-a197-c5c92c1aa0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:26.974065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:26.976051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:26.977370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 989/1965] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:26.985044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e159-e573-44e1-8551-60ff65400a26 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:26.985325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e159-e573-44e1-8551-60ff65400a26 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:26.985602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e159-e573-44e1-8551-60ff65400a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.016840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-abc9e159-e573-44e1-8551-60ff65400a26 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:27.018066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-abc9e159-e573-44e1-8551-60ff65400a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:27.031133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 990/1966] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:27.038961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e159-e573-44e1-8551-60ff65400a26 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:27.055348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e159-e573-44e1-8551-60ff65400a26 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.060250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.061201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.061314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.061705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.062327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:27.062660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.064267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:27.104414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 991/1967] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:48:27.105280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:27.114447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0ef65-c641-4f71-ad51-a626afb076ce admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.130253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.130465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925536f-f87b-4754-a712-0d20d4fccbf7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.132360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.132836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.133305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.135498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:27.141372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9690900-ec1a-48fd-a509-94a929b40e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.142056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690900-ec1a-48fd-a509-94a929b40e62 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.142338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690900-ec1a-48fd-a509-94a929b40e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.142643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690900-ec1a-48fd-a509-94a929b40e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.143350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9690900-ec1a-48fd-a509-94a929b40e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.152125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9690900-ec1a-48fd-a509-94a929b40e62 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:27.227853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.229380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:27.239879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 977/1968] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:27.240770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:27.242220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:27.255743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb2f90-485a-47e7-a524-fd408ffad16f service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.263144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.264050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.264347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.265779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] PATH_INFO: `/v3/users/310583fa3a1147bb831f2f816668222b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.267076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=310583fa3a1147bb831f2f816668222b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.269153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:27.324240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 992/1969] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:27 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:27.329584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9690900-ec1a-48fd-a509-94a929b40e62 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:27.405594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9690900-ec1a-48fd-a509-94a929b40e62 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.414937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.415767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.416066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.416521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.417361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.419510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:27.570056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 993/1970] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:27 2022] POST /identity/v3/users => generated 281 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:27.570803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:27.572531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:27.578331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '310583fa3a1147bb831f2f816668222b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.579020 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '310583fa3a1147bb831f2f816668222b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.579752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '310583fa3a1147bb831f2f816668222b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.585795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f6c435-f1a0-4719-ae98-5d4e41e477c3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.590919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.591825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.592109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.592401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] PATH_INFO: `/v3/projects/590abcb282d24f64b66a818eaff08787` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.593289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '310583fa3a1147bb831f2f816668222b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.593633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=590abcb282d24f64b66a818eaff08787)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.596059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:27.601987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '310583fa3a1147bb831f2f816668222b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.712849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 978/1971] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:27 2022] DELETE /identity/v3/users/310583fa3a1147bb831f2f816668222b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:27.713767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:27.715238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:27.753949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590abcb282d24f64b66a818eaff08787', 'request_id': 'req-6eef3a0e-636e-4d88-bf94-578b4a059670'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.766364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590abcb282d24f64b66a818eaff08787', 'request_id': 'req-6eef3a0e-636e-4d88-bf94-578b4a059670'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.790858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f292e-31c8-4872-afc3-de0930d31cdb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.871281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590abcb282d24f64b66a818eaff08787', 'request_id': 'req-6eef3a0e-636e-4d88-bf94-578b4a059670'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.876266 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.877277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.877801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.878344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.879309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.882041 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:27.889669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] The token cache is being invalidate because project 590abcb282d24f64b66a818eaff08787 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:27.890228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.890810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6eef3a0e-636e-4d88-bf94-578b4a059670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:27.894713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 979/1972] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:27.899946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:27.901428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 994/1973] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:27 2022] DELETE /identity/v3/projects/590abcb282d24f64b66a818eaff08787 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:27.902140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:27.903343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129362-05da-4708-af63-c87f8f6b1395 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.903639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129362-05da-4708-af63-c87f8f6b1395 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.903932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe129362-05da-4708-af63-c87f8f6b1395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.917429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d6a0b-fe0a-471a-9214-82ce689f6bf1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.926684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8643d5f-902d-432f-bbd9-422c74cdfa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.927390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8643d5f-902d-432f-bbd9-422c74cdfa64 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.927390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8643d5f-902d-432f-bbd9-422c74cdfa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.928626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8643d5f-902d-432f-bbd9-422c74cdfa64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.929438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8643d5f-902d-432f-bbd9-422c74cdfa64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.931080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8643d5f-902d-432f-bbd9-422c74cdfa64 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:27.935300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-fe129362-05da-4708-af63-c87f8f6b1395 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:27.936891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fe129362-05da-4708-af63-c87f8f6b1395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:27.941769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 980/1974] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:27.947074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8643d5f-902d-432f-bbd9-422c74cdfa64 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:27.955345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 995/1975] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:27.957571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8643d5f-902d-432f-bbd9-422c74cdfa64 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:27.964392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187ea3-a5ca-47dc-9b23-6c0b6782e84b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.964677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187ea3-a5ca-47dc-9b23-6c0b6782e84b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.964952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187ea3-a5ca-47dc-9b23-6c0b6782e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.969685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0819c11-9bb1-4a96-9234-f6ff67c0db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:27.970742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0819c11-9bb1-4a96-9234-f6ff67c0db51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:27.971100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0819c11-9bb1-4a96-9234-f6ff67c0db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:27.971454 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0819c11-9bb1-4a96-9234-f6ff67c0db51 admin admin] PATH_INFO: `/v3/projects/66b3184259ed4fe58fc5e34185ed6a25/users/ac34600db91a44a28186c78715f2e401/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:27.991797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-97187ea3-a5ca-47dc-9b23-6c0b6782e84b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:27.992745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0819c11-9bb1-4a96-9234-f6ff67c0db51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66b3184259ed4fe58fc5e34185ed6a25, user_id=ac34600db91a44a28186c78715f2e401, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:27.992944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-97187ea3-a5ca-47dc-9b23-6c0b6782e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:27.997385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0819c11-9bb1-4a96-9234-f6ff67c0db51 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.003908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 996/1976] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:28.009715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187ea3-a5ca-47dc-9b23-6c0b6782e84b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:28.010647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:28.023640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187ea3-a5ca-47dc-9b23-6c0b6782e84b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:28.032092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:28.032837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.033185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.033526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.034329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:28.034811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:28.036425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.052535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 997/1977] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:28.053420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:28.055237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:28.068642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff38b6-f867-4f90-a3cc-c6b8895565af admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:28.072155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 981/1978] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:27 2022] PUT /identity/v3/projects/66b3184259ed4fe58fc5e34185ed6a25/users/ac34600db91a44a28186c78715f2e401/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:28.073038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0819c11-9bb1-4a96-9234-f6ff67c0db51 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:28.153361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:28.154257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.154563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.154863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] PATH_INFO: `/v3/projects/190144ea59f04f9da3097e83ee7356e3` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.158735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] RBAC: Authorizing `identity:delete_project(project_id=190144ea59f04f9da3097e83ee7356e3)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:28.158853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0819c11-9bb1-4a96-9234-f6ff67c0db51 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:28.158946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.163545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a0dc4-3eaf-4a41-a191-f78de7e32af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:28.164265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a0dc4-3eaf-4a41-a191-f78de7e32af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.164545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a0dc4-3eaf-4a41-a191-f78de7e32af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.165012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a0dc4-3eaf-4a41-a191-f78de7e32af7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.165862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a0dc4-3eaf-4a41-a191-f78de7e32af7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:28.167971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937a0dc4-3eaf-4a41-a191-f78de7e32af7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.271609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:28.283129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 982/1979] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:28 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:28.283129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfc22-42d2-48b4-a4b1-9c69386ad155 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.283129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfc22-42d2-48b4-a4b1-9c69386ad155 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.283129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09cfc22-42d2-48b4-a4b1-9c69386ad155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.309134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c09cfc22-42d2-48b4-a4b1-9c69386ad155 None None] MFA Rules not processed for user `ac34600db91a44a28186c78715f2e401`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:28.310371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c09cfc22-42d2-48b4-a4b1-9c69386ad155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:28.374407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190144ea59f04f9da3097e83ee7356e3', 'request_id': 'req-9af97cd9-10e7-44eb-9264-57194cfd569b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:28.380440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190144ea59f04f9da3097e83ee7356e3', 'request_id': 'req-9af97cd9-10e7-44eb-9264-57194cfd569b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:28.395217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 983/1980] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:28.395739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cfc22-42d2-48b4-a4b1-9c69386ad155 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:28.473189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09cfc22-42d2-48b4-a4b1-9c69386ad155 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:28.493990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190144ea59f04f9da3097e83ee7356e3', 'request_id': 'req-9af97cd9-10e7-44eb-9264-57194cfd569b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:28.509131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] The token cache is being invalidate because project 190144ea59f04f9da3097e83ee7356e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:28.511286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:28.511286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:28.511780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 998/1981] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:28 2022] DELETE /identity/v3/projects/190144ea59f04f9da3097e83ee7356e3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:28.512764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:28.514376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:28.535842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:28.538188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.538188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.538188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.538188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:28.546497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.580653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af97cd9-10e7-44eb-9264-57194cfd569b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:28.591527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:28.591527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.591527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.591527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.591844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:28.654988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:28.656491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.678618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 999/1982] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:28.679702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:28.681202 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:28.695699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 984/1983] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:28 2022] POST /identity/v3/users => generated 288 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:28.699306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:28.704140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:28.710379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f1532-d253-47e6-b361-02a3b2d08302 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:28.717692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bbef9f-a019-454d-a765-d4d3fbdd1319 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:28.719236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:28.725026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.725026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.725026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] PATH_INFO: `/v3/users/00e763b7b9254fb5b0b5f3e7a3fa563b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.725026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00e763b7b9254fb5b0b5f3e7a3fa563b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:28.725342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:28.725342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:28.725342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:28.725342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] PATH_INFO: `/v3/users/ac34600db91a44a28186c78715f2e401` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:28.725614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.726468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac34600db91a44a28186c78715f2e401)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:28.728490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:28.780400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:29.019841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00e763b7b9254fb5b0b5f3e7a3fa563b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.020320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac34600db91a44a28186c78715f2e401'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.020489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac34600db91a44a28186c78715f2e401'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.020563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00e763b7b9254fb5b0b5f3e7a3fa563b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.021191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac34600db91a44a28186c78715f2e401'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.029265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00e763b7b9254fb5b0b5f3e7a3fa563b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.035251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac34600db91a44a28186c78715f2e401'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.043018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00e763b7b9254fb5b0b5f3e7a3fa563b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.043809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00e763b7b9254fb5b0b5f3e7a3fa563b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.043960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-767f5faf-0bdb-4694-84da-9071d6cf67e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac34600db91a44a28186c78715f2e401'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.169141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1000/1984] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:28 2022] DELETE /identity/v3/users/00e763b7b9254fb5b0b5f3e7a3fa563b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:29.171541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.172874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.244591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786ba25-1bde-4855-bace-1fa15d52bc55 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:29.250037 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:29.250445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 985/1985] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:28 2022] DELETE /identity/v3/users/ac34600db91a44a28186c78715f2e401 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:29.251113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.251399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.255255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.255255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:29.255255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:29.257587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dddbc4-cf02-47e3-b31f-56ee3e300894 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.258082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dddbc4-cf02-47e3-b31f-56ee3e300894 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.258436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dddbc4-cf02-47e3-b31f-56ee3e300894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.271156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1001/1986] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:29.275728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.277765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.280006 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-01dddbc4-cf02-47e3-b31f-56ee3e300894 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:29.281259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-01dddbc4-cf02-47e3-b31f-56ee3e300894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.291449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8164e45c-51aa-40de-ad6f-111df78da3b6 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:29.351225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 986/1987] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:29.359050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736793-34d7-42d8-af1c-da996a70c4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:29.359762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736793-34d7-42d8-af1c-da996a70c4f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.360465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736793-34d7-42d8-af1c-da996a70c4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.360754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84736793-34d7-42d8-af1c-da996a70c4f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.361165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dddbc4-cf02-47e3-b31f-56ee3e300894 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.361512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84736793-34d7-42d8-af1c-da996a70c4f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:29.362658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-01dddbc4-cf02-47e3-b31f-56ee3e300894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.363146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84736793-34d7-42d8-af1c-da996a70c4f9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:29.381163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1002/1988] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:29.382907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736793-34d7-42d8-af1c-da996a70c4f9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.393088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84736793-34d7-42d8-af1c-da996a70c4f9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:29.398348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d2525b-b49f-44a9-89ca-4c571a1cda73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:29.405558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2525b-b49f-44a9-89ca-4c571a1cda73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.405558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2525b-b49f-44a9-89ca-4c571a1cda73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.405558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d2525b-b49f-44a9-89ca-4c571a1cda73 admin admin] PATH_INFO: `/v3/projects/dd8a0c4429a147388c1a738d42ea4bf6/users/b9cc854649d2450a808e4da5ff116ab7/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.416283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2525b-b49f-44a9-89ca-4c571a1cda73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8a0c4429a147388c1a738d42ea4bf6, user_id=b9cc854649d2450a808e4da5ff116ab7, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:29.419108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d2525b-b49f-44a9-89ca-4c571a1cda73 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:29.420858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dddbc4-cf02-47e3-b31f-56ee3e300894 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:29.424377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:29.425018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.425325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.425596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.435601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:29.437019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:29.447113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 987/1989] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:29.532146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1003/1990] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:29 2022] PUT /identity/v3/projects/dd8a0c4429a147388c1a738d42ea4bf6/users/b9cc854649d2450a808e4da5ff116ab7/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:29.532515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.532515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.535777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0d12f-658b-4d00-b38b-d6a27f07ae85 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.536856 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0d12f-658b-4d00-b38b-d6a27f07ae85 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.536856 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0d12f-658b-4d00-b38b-d6a27f07ae85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.548232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc5493-0ec0-44bd-88b3-d38759facc04 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:29.577689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4ac0d12f-658b-4d00-b38b-d6a27f07ae85 None None] MFA Rules not processed for user `b9cc854649d2450a808e4da5ff116ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:29.578982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4ac0d12f-658b-4d00-b38b-d6a27f07ae85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.613132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:29.614002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.614290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.614588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] PATH_INFO: `/v3/projects/76d2b58574774fad9c9a46db86f41668` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.616314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d2b58574774fad9c9a46db86f41668)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:29.618324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:29.647738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1004/1991] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:29.652206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0d12f-658b-4d00-b38b-d6a27f07ae85 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.662722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0d12f-658b-4d00-b38b-d6a27f07ae85 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:29.667545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969fbf1-ae01-43e2-a919-77ff4244c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:29.668191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969fbf1-ae01-43e2-a919-77ff4244c578 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.668469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969fbf1-ae01-43e2-a919-77ff4244c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.668739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969fbf1-ae01-43e2-a919-77ff4244c578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.669461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969fbf1-ae01-43e2-a919-77ff4244c578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:29.671374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7969fbf1-ae01-43e2-a919-77ff4244c578 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:29.798645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d2b58574774fad9c9a46db86f41668', 'request_id': 'req-08c0f9c6-038f-47a2-8550-d0a9697f9463'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.805510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d2b58574774fad9c9a46db86f41668', 'request_id': 'req-08c0f9c6-038f-47a2-8550-d0a9697f9463'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.812395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d2b58574774fad9c9a46db86f41668', 'request_id': 'req-08c0f9c6-038f-47a2-8550-d0a9697f9463'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.822317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1005/1992] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:29 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:29.823119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969fbf1-ae01-43e2-a919-77ff4244c578 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:29.904337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969fbf1-ae01-43e2-a919-77ff4244c578 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:29.915622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:29.918653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.920498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.920498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.920498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:29.922576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:29.940086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] The token cache is being invalidate because project 76d2b58574774fad9c9a46db86f41668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:29.940086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.940086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-08c0f9c6-038f-47a2-8550-d0a9697f9463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:29.940086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 988/1993] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:29 2022] DELETE /identity/v3/projects/76d2b58574774fad9c9a46db86f41668 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:29.943407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4f5cb-dfc2-42d9-b0d9-1ef2e55c8360 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.943651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4f5cb-dfc2-42d9-b0d9-1ef2e55c8360 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.943923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4f5cb-dfc2-42d9-b0d9-1ef2e55c8360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:29.963588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4fe4f5cb-dfc2-42d9-b0d9-1ef2e55c8360 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:29.964796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4fe4f5cb-dfc2-42d9-b0d9-1ef2e55c8360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:29.975915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 989/1994] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:29.983643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbef82-50b0-4049-a547-1fe0eef509f6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:29.986891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbef82-50b0-4049-a547-1fe0eef509f6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:29.986891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbef82-50b0-4049-a547-1fe0eef509f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.004524 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-81fbef82-50b0-4049-a547-1fe0eef509f6 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:30.006312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-81fbef82-50b0-4049-a547-1fe0eef509f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:30.016850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 990/1995] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:30.022336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbef82-50b0-4049-a547-1fe0eef509f6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.031786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbef82-50b0-4049-a547-1fe0eef509f6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.036513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.038702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.038702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.038702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.038919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:30.039107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.040774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.052777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 991/1996] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:48:30.057473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.068135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da4bdf-91ff-42bb-85e0-a2f5273a1522 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.070169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1006/1997] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:29 2022] POST /identity/v3/users => generated 294 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:30.071629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.074620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:30.077846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.078615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.079027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.079894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.080605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.082823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.088491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc043db-d276-4f6e-9561-8d3c236938d3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.093629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.094834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.095121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.095556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] PATH_INFO: `/v3/projects/66b3184259ed4fe58fc5e34185ed6a25` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.097074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] RBAC: Authorizing `identity:delete_project(project_id=66b3184259ed4fe58fc5e34185ed6a25)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.101940 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.199463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 992/1998] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:30 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:30.200538 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.202123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:30.264138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66b3184259ed4fe58fc5e34185ed6a25', 'request_id': 'req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:30.274653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66b3184259ed4fe58fc5e34185ed6a25', 'request_id': 'req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:30.276520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f12276-7bf7-4f8b-83c7-8ed8199c6f92 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.342782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9af41-d472-464a-9f8f-a3e892bd17d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.343788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9af41-d472-464a-9f8f-a3e892bd17d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.344067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9af41-d472-464a-9f8f-a3e892bd17d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.344342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9af41-d472-464a-9f8f-a3e892bd17d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.345148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9af41-d472-464a-9f8f-a3e892bd17d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.346995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9af41-d472-464a-9f8f-a3e892bd17d6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.361660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 993/1999] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:30.361660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9af41-d472-464a-9f8f-a3e892bd17d6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.373283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9af41-d472-464a-9f8f-a3e892bd17d6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.378489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64342a14-4816-4020-874d-b7c9b3105a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.379254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342a14-4816-4020-874d-b7c9b3105a33 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.379538 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342a14-4816-4020-874d-b7c9b3105a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.379810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64342a14-4816-4020-874d-b7c9b3105a33 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.380505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64342a14-4816-4020-874d-b7c9b3105a33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.383475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64342a14-4816-4020-874d-b7c9b3105a33 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.648838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66b3184259ed4fe58fc5e34185ed6a25', 'request_id': 'req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:30.672232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] The token cache is being invalidate because project 66b3184259ed4fe58fc5e34185ed6a25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:30.672232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:30.672232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:30.672232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1007/2000] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:30 2022] DELETE /identity/v3/projects/66b3184259ed4fe58fc5e34185ed6a25 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:30.672232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.676198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:30.689415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9e915-695c-4f02-bb0d-67efd7c9a90e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.695372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ed2f5-9d2d-475f-a532-030157b1b91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.696280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ed2f5-9d2d-475f-a532-030157b1b91c admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.696567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ed2f5-9d2d-475f-a532-030157b1b91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.696890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ed2f5-9d2d-475f-a532-030157b1b91c admin admin] PATH_INFO: `/v3/projects/5e239ce9bed345b29288c639eeed3899/users/6fe49a65257241c4a0803941e4dec6bc/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.711332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 994/2001] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:30 2022] POST /identity/v3/users => generated 285 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:30.712643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aee13-3ada-4438-8c78-f925358b3300 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.712931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aee13-3ada-4438-8c78-f925358b3300 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.713226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aee13-3ada-4438-8c78-f925358b3300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.715972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ed2f5-9d2d-475f-a532-030157b1b91c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e239ce9bed345b29288c639eeed3899, user_id=6fe49a65257241c4a0803941e4dec6bc, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.718767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ed2f5-9d2d-475f-a532-030157b1b91c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.733688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-479aee13-3ada-4438-8c78-f925358b3300 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:30.734964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-479aee13-3ada-4438-8c78-f925358b3300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:30.755840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 995/2002] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:30.755840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aee13-3ada-4438-8c78-f925358b3300 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.755840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-479aee13-3ada-4438-8c78-f925358b3300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:30.767638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aee13-3ada-4438-8c78-f925358b3300 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.773875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d030c-2b54-44b9-8ed3-5f75e5387ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.774714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d030c-2b54-44b9-8ed3-5f75e5387ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.774883 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d030c-2b54-44b9-8ed3-5f75e5387ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.775158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d030c-2b54-44b9-8ed3-5f75e5387ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.775902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d030c-2b54-44b9-8ed3-5f75e5387ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.777579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d030c-2b54-44b9-8ed3-5f75e5387ac1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.789907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 996/2003] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:30.791134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5608-df24-4613-9b1d-bf72a3e8cfa1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.791426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5608-df24-4613-9b1d-bf72a3e8cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.791706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be5608-df24-4613-9b1d-bf72a3e8cfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.810485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c9be5608-df24-4613-9b1d-bf72a3e8cfa1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:30.811711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c9be5608-df24-4613-9b1d-bf72a3e8cfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:30.820584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 997/2004] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:30.821402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be5608-df24-4613-9b1d-bf72a3e8cfa1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.831331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be5608-df24-4613-9b1d-bf72a3e8cfa1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.836967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa7083-fa79-43cc-b88a-616f01ceacdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.837644 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa7083-fa79-43cc-b88a-616f01ceacdf admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.837934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa7083-fa79-43cc-b88a-616f01ceacdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.838199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa7083-fa79-43cc-b88a-616f01ceacdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.839029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa7083-fa79-43cc-b88a-616f01ceacdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.840629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa7083-fa79-43cc-b88a-616f01ceacdf admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.855130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 998/2005] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:30.855130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa7083-fa79-43cc-b88a-616f01ceacdf admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.862150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa7083-fa79-43cc-b88a-616f01ceacdf admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.866727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.867373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.867651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.867921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.868637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:30.868938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.870507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:30.885614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 999/2006] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:30.886432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:30.897092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5461ff3-a6e5-44f8-bb8a-4e701ca3341d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:30.901994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab56012-defe-4d66-becb-157a074f41ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:30.908933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab56012-defe-4d66-becb-157a074f41ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:30.908933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab56012-defe-4d66-becb-157a074f41ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:30.908933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab56012-defe-4d66-becb-157a074f41ff admin admin] PATH_INFO: `/v3/projects/1e46fabf2a7d4a9885bf6a0f528a1f93/users/ee5f74a1260844f9b9778031da19e93d/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:30.918914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab56012-defe-4d66-becb-157a074f41ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e46fabf2a7d4a9885bf6a0f528a1f93, user_id=ee5f74a1260844f9b9778031da19e93d, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:30.921676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab56012-defe-4d66-becb-157a074f41ff admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:31.258887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1008/2007] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:30 2022] PUT /identity/v3/projects/5e239ce9bed345b29288c639eeed3899/users/6fe49a65257241c4a0803941e4dec6bc/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:31.260876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ed2f5-9d2d-475f-a532-030157b1b91c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.318157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1000/2008] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:30 2022] PUT /identity/v3/projects/1e46fabf2a7d4a9885bf6a0f528a1f93/users/ee5f74a1260844f9b9778031da19e93d/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:31.327145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab56012-defe-4d66-becb-157a074f41ff admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.331974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ed2f5-9d2d-475f-a532-030157b1b91c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.402246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d15027-fe8e-4ccf-af1d-fbe9d67af2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.403753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab56012-defe-4d66-becb-157a074f41ff admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.404373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d15027-fe8e-4ccf-af1d-fbe9d67af2ec admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.404766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d15027-fe8e-4ccf-af1d-fbe9d67af2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.405050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d15027-fe8e-4ccf-af1d-fbe9d67af2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.406045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d15027-fe8e-4ccf-af1d-fbe9d67af2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.408542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d15027-fe8e-4ccf-af1d-fbe9d67af2ec admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:31.410506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ffcd19-8481-438c-8be4-52691949ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.411261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffcd19-8481-438c-8be4-52691949ebea admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.411540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffcd19-8481-438c-8be4-52691949ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.413153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ffcd19-8481-438c-8be4-52691949ebea admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.413850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffcd19-8481-438c-8be4-52691949ebea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.416498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ffcd19-8481-438c-8be4-52691949ebea admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:31.422503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:31.429943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1001/2009] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:31.431316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5bb80-1303-4847-954b-1c17874e0693 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.431606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5bb80-1303-4847-954b-1c17874e0693 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.431861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab5bb80-1303-4847-954b-1c17874e0693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.464019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-bab5bb80-1303-4847-954b-1c17874e0693 None None] MFA Rules not processed for user `ee5f74a1260844f9b9778031da19e93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:31.465243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bab5bb80-1303-4847-954b-1c17874e0693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:31.522925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1009/2010] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:31 2022] POST /identity/v3/projects => generated 377 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:31.523786 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d15027-fe8e-4ccf-af1d-fbe9d67af2ec admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.544446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1002/2011] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:31.547059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5bb80-1303-4847-954b-1c17874e0693 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.557139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab5bb80-1303-4847-954b-1c17874e0693 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.597993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d15027-fe8e-4ccf-af1d-fbe9d67af2ec admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.606354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efccc4-6d20-460c-8d89-c014e80a6434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.607333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efccc4-6d20-460c-8d89-c014e80a6434 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.607614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efccc4-6d20-460c-8d89-c014e80a6434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.607885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efccc4-6d20-460c-8d89-c014e80a6434 admin admin] PATH_INFO: `/v3/projects/5e239ce9bed345b29288c639eeed3899/users/6fe49a65257241c4a0803941e4dec6bc/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.610103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efccc4-6d20-460c-8d89-c014e80a6434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e239ce9bed345b29288c639eeed3899, user_id=6fe49a65257241c4a0803941e4dec6bc, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.612885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efccc4-6d20-460c-8d89-c014e80a6434 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:31.634113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1010/2012] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:31 2022] PUT /identity/v3/projects/5e239ce9bed345b29288c639eeed3899/users/6fe49a65257241c4a0803941e4dec6bc/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:31.635340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efccc4-6d20-460c-8d89-c014e80a6434 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.655619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefaf68-17bc-42d1-8901-41231a85cec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.657422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefaf68-17bc-42d1-8901-41231a85cec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.658250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefaf68-17bc-42d1-8901-41231a85cec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.662857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefaf68-17bc-42d1-8901-41231a85cec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.664244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefaf68-17bc-42d1-8901-41231a85cec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.679125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefaf68-17bc-42d1-8901-41231a85cec9 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:31.736244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efccc4-6d20-460c-8d89-c014e80a6434 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.742332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d43f7-2f3a-43fb-b903-4abd25d37fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.743043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d43f7-2f3a-43fb-b903-4abd25d37fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.743390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d43f7-2f3a-43fb-b903-4abd25d37fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.743753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d43f7-2f3a-43fb-b903-4abd25d37fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.744374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d43f7-2f3a-43fb-b903-4abd25d37fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.746993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d43f7-2f3a-43fb-b903-4abd25d37fe2 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:31.823950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1003/2013] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:31 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:31.823950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233898-c474-4fa2-bf75-701ceb6644bc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.823950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233898-c474-4fa2-bf75-701ceb6644bc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.823950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e233898-c474-4fa2-bf75-701ceb6644bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.853584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9e233898-c474-4fa2-bf75-701ceb6644bc None None] MFA Rules not processed for user `6fe49a65257241c4a0803941e4dec6bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:31.858628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9e233898-c474-4fa2-bf75-701ceb6644bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:31.862372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1011/2014] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:31 2022] POST /identity/v3/projects => generated 369 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:31.863524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d43f7-2f3a-43fb-b903-4abd25d37fe2 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.957238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1004/2015] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:31.957568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d43f7-2f3a-43fb-b903-4abd25d37fe2 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.957669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e233898-c474-4fa2-bf75-701ceb6644bc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.961796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.962478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.962904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.963271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.964226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.972469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:31.973108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e233898-c474-4fa2-bf75-701ceb6644bc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:31.982835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1012/2016] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:31.982835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:31.983106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:31.984459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f1734-7a41-4658-a7d7-b0ccecd9ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:31.985150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1734-7a41-4658-a7d7-b0ccecd9ef79 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:31.985429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1734-7a41-4658-a7d7-b0ccecd9ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:31.985699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f1734-7a41-4658-a7d7-b0ccecd9ef79 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:31.986447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f1734-7a41-4658-a7d7-b0ccecd9ef79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:31.988467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f1734-7a41-4658-a7d7-b0ccecd9ef79 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.008112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:32.062992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7058ed58-f42a-4b59-994a-9c70299bbcba admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:32.069994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:32.069994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.069994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.069994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.070550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:32.101812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1005/2017] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:31 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:32.101812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f1734-7a41-4658-a7d7-b0ccecd9ef79 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:32.123050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f1734-7a41-4658-a7d7-b0ccecd9ef79 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:32.132932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05400e-0349-4159-b74a-230d2cab64a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:32.133116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05400e-0349-4159-b74a-230d2cab64a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.133401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05400e-0349-4159-b74a-230d2cab64a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.133694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e05400e-0349-4159-b74a-230d2cab64a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.134432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05400e-0349-4159-b74a-230d2cab64a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:32.136097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e05400e-0349-4159-b74a-230d2cab64a1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.148739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1006/2018] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:32.149674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05400e-0349-4159-b74a-230d2cab64a1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:32.157258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:32.160564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.166178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e05400e-0349-4159-b74a-230d2cab64a1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:32.171615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d655c5-db66-4326-8234-aff84edd43de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:32.175085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d655c5-db66-4326-8234-aff84edd43de admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.175085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d655c5-db66-4326-8234-aff84edd43de admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.175085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d655c5-db66-4326-8234-aff84edd43de admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.175368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1013/2019] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:32.175645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:32.185320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d655c5-db66-4326-8234-aff84edd43de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:32.190409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d655c5-db66-4326-8234-aff84edd43de admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.195319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330eba91-e9f9-4a22-87e0-48be2cc512de service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:32.201529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c31035f-59e6-4375-9447-9b5a0a92ee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:32.202833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31035f-59e6-4375-9447-9b5a0a92ee2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.203182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31035f-59e6-4375-9447-9b5a0a92ee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.203632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c31035f-59e6-4375-9447-9b5a0a92ee2f admin admin] PATH_INFO: `/v3/projects/d7f3ba0d42744940a8876058dc29dc89/users/12bf0a524d8e424da0f25f0fe7282c61/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.220562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1007/2020] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:32.227070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d655c5-db66-4326-8234-aff84edd43de admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:32.228883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31035f-59e6-4375-9447-9b5a0a92ee2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7f3ba0d42744940a8876058dc29dc89, user_id=12bf0a524d8e424da0f25f0fe7282c61, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:32.231729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c31035f-59e6-4375-9447-9b5a0a92ee2f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.242086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d655c5-db66-4326-8234-aff84edd43de admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:32.247910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905010e7-01f1-433b-83c1-524fa5e6aaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:32.249391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905010e7-01f1-433b-83c1-524fa5e6aaab admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.249391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905010e7-01f1-433b-83c1-524fa5e6aaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.249840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905010e7-01f1-433b-83c1-524fa5e6aaab admin admin] PATH_INFO: `/v3/projects/710d3da9ae51493d8a737a3d0d5f20d0/users/0b308dbdd1fc440490ebc615b15dd2cc/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.266233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905010e7-01f1-433b-83c1-524fa5e6aaab admin admin] RBAC: Authorizing `identity:create_grant(project_id=710d3da9ae51493d8a737a3d0d5f20d0, user_id=0b308dbdd1fc440490ebc615b15dd2cc, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:32.269214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905010e7-01f1-433b-83c1-524fa5e6aaab admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.324415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1014/2021] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:32 2022] PUT /identity/v3/projects/d7f3ba0d42744940a8876058dc29dc89/users/12bf0a524d8e424da0f25f0fe7282c61/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:32.335167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bec48-878e-4281-8298-a74be44ef5f0 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.343859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bec48-878e-4281-8298-a74be44ef5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.343859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bec48-878e-4281-8298-a74be44ef5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.378242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b48bec48-878e-4281-8298-a74be44ef5f0 None None] MFA Rules not processed for user `12bf0a524d8e424da0f25f0fe7282c61`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:32.379629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b48bec48-878e-4281-8298-a74be44ef5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:32.415346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1008/2022] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:32 2022] PUT /identity/v3/projects/710d3da9ae51493d8a737a3d0d5f20d0/users/0b308dbdd1fc440490ebc615b15dd2cc/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:32.419347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905010e7-01f1-433b-83c1-524fa5e6aaab admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:32.456935 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1015/2023] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:32.487276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905010e7-01f1-433b-83c1-524fa5e6aaab admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:32.492582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:32.493359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.493713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.494063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.494900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:32.496564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.506929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1009/2024] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:32.511246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bec48-878e-4281-8298-a74be44ef5f0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:32.534817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:32.537117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:32.588865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bec48-878e-4281-8298-a74be44ef5f0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:32.603979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad244ea-c8b9-46ea-ae88-1ef6cc2aa772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:32.605203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad244ea-c8b9-46ea-ae88-1ef6cc2aa772 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.605437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad244ea-c8b9-46ea-ae88-1ef6cc2aa772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.605737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad244ea-c8b9-46ea-ae88-1ef6cc2aa772 admin admin] PATH_INFO: `/v3/projects/710d3da9ae51493d8a737a3d0d5f20d0/users/0b308dbdd1fc440490ebc615b15dd2cc/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.607898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad244ea-c8b9-46ea-ae88-1ef6cc2aa772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=710d3da9ae51493d8a737a3d0d5f20d0, user_id=0b308dbdd1fc440490ebc615b15dd2cc, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:32.609506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5671aa-5728-4c20-bd7a-addf22ed58d5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:32.610791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad244ea-c8b9-46ea-ae88-1ef6cc2aa772 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.616099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79cac4-1e4e-4890-946a-fe7ec0bc3b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:32.616099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79cac4-1e4e-4890-946a-fe7ec0bc3b1e service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.616099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79cac4-1e4e-4890-946a-fe7ec0bc3b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.616099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af79cac4-1e4e-4890-946a-fe7ec0bc3b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.624413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1016/2025] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:32 2022] PUT /identity/v3/projects/710d3da9ae51493d8a737a3d0d5f20d0/users/0b308dbdd1fc440490ebc615b15dd2cc/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:32.635034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0f86-fb44-4726-b3d7-3d90cbe61068 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:32.635469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0f86-fb44-4726-b3d7-3d90cbe61068 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:32.635840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f0f86-fb44-4726-b3d7-3d90cbe61068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:32.670647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-488f0f86-fb44-4726-b3d7-3d90cbe61068 None None] MFA Rules not processed for user `0b308dbdd1fc440490ebc615b15dd2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:32.671892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-488f0f86-fb44-4726-b3d7-3d90cbe61068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:32.692311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79cac4-1e4e-4890-946a-fe7ec0bc3b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:32.693911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af79cac4-1e4e-4890-946a-fe7ec0bc3b1e service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:32.705357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1010/2026] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:32.767517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1017/2027] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:32 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:33.201783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79cac4-1e4e-4890-946a-fe7ec0bc3b1e service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:33.210565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af79cac4-1e4e-4890-946a-fe7ec0bc3b1e service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:33.267415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424bff14-411f-4e2c-b10f-15805d12f42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:33.268098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bff14-411f-4e2c-b10f-15805d12f42c service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:33.268381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bff14-411f-4e2c-b10f-15805d12f42c service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:33.268656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424bff14-411f-4e2c-b10f-15805d12f42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:33.279903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bff14-411f-4e2c-b10f-15805d12f42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:33.281272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424bff14-411f-4e2c-b10f-15805d12f42c service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:33.293053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1011/2028] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:33 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:35.156873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:35.876933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:37.872318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f0f86-fb44-4726-b3d7-3d90cbe61068 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:37.985991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f0f86-fb44-4726-b3d7-3d90cbe61068 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:37.993246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:37.995133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:38.004991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:38.004991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] PATH_INFO: `/v3/users/b9cc854649d2450a808e4da5ff116ab7` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:38.004991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cc854649d2450a808e4da5ff116ab7)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:38.004991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:38.447652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cc854649d2450a808e4da5ff116ab7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.449628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cc854649d2450a808e4da5ff116ab7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.458495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cc854649d2450a808e4da5ff116ab7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.472436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cc854649d2450a808e4da5ff116ab7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.473230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cc854649d2450a808e4da5ff116ab7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.557086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:38.610834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1018/2029] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:37 2022] DELETE /identity/v3/users/b9cc854649d2450a808e4da5ff116ab7 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:38.616089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2303-f485-436d-bc86-ecdcb14eea0d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:38.616563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2303-f485-436d-bc86-ecdcb14eea0d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:38.616685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2303-f485-436d-bc86-ecdcb14eea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:38.636883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:38.639670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:38.652377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0bfa2303-f485-436d-bc86-ecdcb14eea0d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:38.653933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0bfa2303-f485-436d-bc86-ecdcb14eea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:38.717427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b303a14-fedf-423d-9065-6f136c4e3cc9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:38.724844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1012/2030] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:38.731126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa2303-f485-436d-bc86-ecdcb14eea0d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:38.731966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:38.733032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:38.733167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0bfa2303-f485-436d-bc86-ecdcb14eea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:38.733428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:38.733779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] PATH_INFO: `/v3/users/c7eeecd2d826456f9f1734faa3e5042e` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:38.735339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7eeecd2d826456f9f1734faa3e5042e)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:38.740970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:38.796877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa2303-f485-436d-bc86-ecdcb14eea0d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:38.803859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002117df-8971-49f6-b308-7faf221d0b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:38.804627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002117df-8971-49f6-b308-7faf221d0b12 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:38.804908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002117df-8971-49f6-b308-7faf221d0b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:38.805181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002117df-8971-49f6-b308-7faf221d0b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:38.816667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002117df-8971-49f6-b308-7faf221d0b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:38.818597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002117df-8971-49f6-b308-7faf221d0b12 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:38.836616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1013/2031] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:38.969132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7eeecd2d826456f9f1734faa3e5042e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.970063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7eeecd2d826456f9f1734faa3e5042e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.979704 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7eeecd2d826456f9f1734faa3e5042e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.991019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7eeecd2d826456f9f1734faa3e5042e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:38.991952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7eeecd2d826456f9f1734faa3e5042e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.082353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1019/2032] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:38 2022] DELETE /identity/v3/users/c7eeecd2d826456f9f1734faa3e5042e => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:39.088422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396f28-fb6c-460a-8224-56e59206c90b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:39.088422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396f28-fb6c-460a-8224-56e59206c90b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:39.088422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d396f28-fb6c-460a-8224-56e59206c90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:39.107410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8d396f28-fb6c-460a-8224-56e59206c90b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:39.108535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8d396f28-fb6c-460a-8224-56e59206c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:39.174879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:39.183087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1014/2033] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:39.195768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:39.197471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:39.260360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14a71-8f1e-46d7-b205-f44efc18602f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:39.264183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:39.264841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:39.265127 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:39.265401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:39.275662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:39.277096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:39.289221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1020/2034] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:39.382739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d396f28-fb6c-460a-8224-56e59206c90b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:39.384638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8d396f28-fb6c-460a-8224-56e59206c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:39.407789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d396f28-fb6c-460a-8224-56e59206c90b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:39.413258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:39.414675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:39.415040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:39.415320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] PATH_INFO: `/v3/projects/dd8a0c4429a147388c1a738d42ea4bf6` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:39.416564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8a0c4429a147388c1a738d42ea4bf6)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:39.418627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:39.612334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8a0c4429a147388c1a738d42ea4bf6', 'request_id': 'req-b6761643-874a-4ec7-b35f-2ca72d4eec2e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.618972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8a0c4429a147388c1a738d42ea4bf6', 'request_id': 'req-b6761643-874a-4ec7-b35f-2ca72d4eec2e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.624955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8a0c4429a147388c1a738d42ea4bf6', 'request_id': 'req-b6761643-874a-4ec7-b35f-2ca72d4eec2e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.801490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] The token cache is being invalidate because project dd8a0c4429a147388c1a738d42ea4bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:39.824356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.824356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:39.824356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1015/2035] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:39 2022] DELETE /identity/v3/projects/dd8a0c4429a147388c1a738d42ea4bf6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:39.827734 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:39.827867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:39.829490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:39.829614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:39.843246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f447b97-9241-47d2-a290-1d664ba7ec6e service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:39.922996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6761643-874a-4ec7-b35f-2ca72d4eec2e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:39.923306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:39.924303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:39.924606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:39.924980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] PATH_INFO: `/v3/users/ee5f74a1260844f9b9778031da19e93d` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:39.926518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee5f74a1260844f9b9778031da19e93d)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:39.929125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:39.931193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:39.932317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:39.932463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:39.932832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] PATH_INFO: `/v3/users/6fe49a65257241c4a0803941e4dec6bc` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:39.934310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe49a65257241c4a0803941e4dec6bc)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:39.936764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:40.190980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe49a65257241c4a0803941e4dec6bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.191555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe49a65257241c4a0803941e4dec6bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.192158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe49a65257241c4a0803941e4dec6bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.204322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe49a65257241c4a0803941e4dec6bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.211976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe49a65257241c4a0803941e4dec6bc'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.234515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee5f74a1260844f9b9778031da19e93d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.235388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee5f74a1260844f9b9778031da19e93d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.243047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee5f74a1260844f9b9778031da19e93d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.255293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee5f74a1260844f9b9778031da19e93d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.256942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e30d3ccf-6a5c-4346-8d6e-47e4b4701224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee5f74a1260844f9b9778031da19e93d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.391998 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1016/2036] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:39 2022] DELETE /identity/v3/users/6fe49a65257241c4a0803941e4dec6bc => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:40.392991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:40.394440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.474890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f49ce-67a8-4c39-9d6a-8bc0ef4d8161 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:40.479750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:40.480629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:40.480912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:40.481207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] PATH_INFO: `/v3/projects/371cee4cb3654a84be4b2e5cf3f7d295` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:40.482421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=371cee4cb3654a84be4b2e5cf3f7d295)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:40.484361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:40.538239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1021/2037] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:39 2022] DELETE /identity/v3/users/ee5f74a1260844f9b9778031da19e93d => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:40.543017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555a58e-c499-4b60-8937-71d0876e25e8 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:40.543308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555a58e-c499-4b60-8937-71d0876e25e8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:40.543589 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d555a58e-c499-4b60-8937-71d0876e25e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:40.562211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-d555a58e-c499-4b60-8937-71d0876e25e8 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:40.563453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d555a58e-c499-4b60-8937-71d0876e25e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.622330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1022/2038] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:40.632805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555a58e-c499-4b60-8937-71d0876e25e8 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:40.634224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d555a58e-c499-4b60-8937-71d0876e25e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.690669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d555a58e-c499-4b60-8937-71d0876e25e8 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:40.695518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:40.696176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:40.696455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:40.696726 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:40.708635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '371cee4cb3654a84be4b2e5cf3f7d295', 'request_id': 'req-2a972da5-1c70-433f-b8e5-29cd94ccc49d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.709478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:40.709957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:40.716115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '371cee4cb3654a84be4b2e5cf3f7d295', 'request_id': 'req-2a972da5-1c70-433f-b8e5-29cd94ccc49d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.721294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1023/2039] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:40.722237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '371cee4cb3654a84be4b2e5cf3f7d295', 'request_id': 'req-2a972da5-1c70-433f-b8e5-29cd94ccc49d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.831854 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] The token cache is being invalidate because project 371cee4cb3654a84be4b2e5cf3f7d295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:40.832149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.837165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:40.839158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1017/2040] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:40 2022] DELETE /identity/v3/projects/371cee4cb3654a84be4b2e5cf3f7d295 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:40.842933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:40.844365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:40.858045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca241159-5242-4076-84de-3339c72bc2f8 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:40.921298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:40.922187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:40.922467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:40.922776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] PATH_INFO: `/v3/users/031b2bbbbd734fefb0713bf63047db2b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:40.923973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=031b2bbbbd734fefb0713bf63047db2b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:40.925889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:40.981206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:40.982833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.029730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972da5-1c70-433f-b8e5-29cd94ccc49d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.042821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.043764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.044055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.044618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] PATH_INFO: `/v3/projects/5e239ce9bed345b29288c639eeed3899` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.045535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e239ce9bed345b29288c639eeed3899)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.048445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.276049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '031b2bbbbd734fefb0713bf63047db2b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.277366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '031b2bbbbd734fefb0713bf63047db2b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.288257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '031b2bbbbd734fefb0713bf63047db2b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.303297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '031b2bbbbd734fefb0713bf63047db2b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.304330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '031b2bbbbd734fefb0713bf63047db2b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.323031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e239ce9bed345b29288c639eeed3899', 'request_id': 'req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.330232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e239ce9bed345b29288c639eeed3899', 'request_id': 'req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.345755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e239ce9bed345b29288c639eeed3899', 'request_id': 'req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.449272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1024/2041] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:40 2022] DELETE /identity/v3/users/031b2bbbbd734fefb0713bf63047db2b => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:41.450118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.453562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.525057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45420a4-dab0-4bf9-87ba-68c81f10ea43 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.530376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.531450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.531813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.532177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] PATH_INFO: `/v3/projects/1e46fabf2a7d4a9885bf6a0f528a1f93` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.533733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e46fabf2a7d4a9885bf6a0f528a1f93)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.536147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.603698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] The token cache is being invalidate because project 5e239ce9bed345b29288c639eeed3899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:41.603998 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.604615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6ad9ab97-fe36-4ff3-b014-13ebe9bb1dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.606312 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1018/2042] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:40 2022] DELETE /identity/v3/projects/5e239ce9bed345b29288c639eeed3899 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:41.611743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbe80-f712-47ba-bcc0-bb427955b4c4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.612082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbe80-f712-47ba-bcc0-bb427955b4c4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.612410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbdbe80-f712-47ba-bcc0-bb427955b4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.632414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6bbdbe80-f712-47ba-bcc0-bb427955b4c4 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:41.633730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6bbdbe80-f712-47ba-bcc0-bb427955b4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.642032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1019/2043] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:41.652075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf0f8-027b-4165-afd0-c7d352b5d564 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.652415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf0f8-027b-4165-afd0-c7d352b5d564 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.652725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dcf0f8-027b-4165-afd0-c7d352b5d564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.672128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e9dcf0f8-027b-4165-afd0-c7d352b5d564 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:41.673498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e9dcf0f8-027b-4165-afd0-c7d352b5d564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.682323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1020/2044] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:41.687242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcf0f8-027b-4165-afd0-c7d352b5d564 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.697574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dcf0f8-027b-4165-afd0-c7d352b5d564 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.702199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.702904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.703184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.703464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.704187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:41.704496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.706166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.718969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1021/2045] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:48:41.723338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.736418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c71af-2584-416b-abe2-472ba6caf9da admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.747480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e46fabf2a7d4a9885bf6a0f528a1f93', 'request_id': 'req-0bc2b684-98c2-4bc5-a102-e715448bdcda'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.753649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e46fabf2a7d4a9885bf6a0f528a1f93', 'request_id': 'req-0bc2b684-98c2-4bc5-a102-e715448bdcda'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.768380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:41.806930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.807610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.807888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.808168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.808871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.811614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.853939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e46fabf2a7d4a9885bf6a0f528a1f93', 'request_id': 'req-0bc2b684-98c2-4bc5-a102-e715448bdcda'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.866394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] The token cache is being invalidate because project 1e46fabf2a7d4a9885bf6a0f528a1f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:41.866394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.867145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:41.869049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1025/2046] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:41 2022] DELETE /identity/v3/projects/1e46fabf2a7d4a9885bf6a0f528a1f93 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:41.872811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.874186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.888383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2b684-98c2-4bc5-a102-e715448bdcda admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:41.893338 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:41.894229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:41.894512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:41.894815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] PATH_INFO: `/v3/users/0b308dbdd1fc440490ebc615b15dd2cc` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:41.896036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b308dbdd1fc440490ebc615b15dd2cc)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:41.898802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:41.923750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1022/2047] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:41 2022] POST /identity/v3/projects => generated 383 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:41.925127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:41.926895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:41.995641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809ea4b-7994-403c-9850-5b6d807e0aa6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.000627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.001331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.001615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.001919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.002787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.004729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.112683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1023/2048] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:41 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:42.113740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.115720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.126481 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b308dbdd1fc440490ebc615b15dd2cc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.127194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b308dbdd1fc440490ebc615b15dd2cc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.130939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abff99e-d138-421d-bdcf-f0e481d5f92d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.142612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b308dbdd1fc440490ebc615b15dd2cc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.145293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.146193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.146503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.147451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] PATH_INFO: `/v3/projects/b8afcd3ac1ce428983de300044e4395c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.148925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8afcd3ac1ce428983de300044e4395c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.149118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b308dbdd1fc440490ebc615b15dd2cc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.149909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b308dbdd1fc440490ebc615b15dd2cc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.150901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.299524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1026/2049] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:41 2022] DELETE /identity/v3/users/0b308dbdd1fc440490ebc615b15dd2cc => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:42.301165 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.302638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.332770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:42.338257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8afcd3ac1ce428983de300044e4395c', 'request_id': 'req-09a052e5-58db-4721-88cf-3b3e2c960ea4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.342428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8afcd3ac1ce428983de300044e4395c', 'request_id': 'req-09a052e5-58db-4721-88cf-3b3e2c960ea4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.348893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8afcd3ac1ce428983de300044e4395c', 'request_id': 'req-09a052e5-58db-4721-88cf-3b3e2c960ea4'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.402410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f730da6-4fae-4112-a70c-9252ec338bbb admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.407641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684ca1f-d632-4d5f-bf33-3b918e286e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.408295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684ca1f-d632-4d5f-bf33-3b918e286e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.408568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684ca1f-d632-4d5f-bf33-3b918e286e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.410596 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684ca1f-d632-4d5f-bf33-3b918e286e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.410596 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684ca1f-d632-4d5f-bf33-3b918e286e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.411241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0684ca1f-d632-4d5f-bf33-3b918e286e10 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.423406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1027/2050] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:42.429527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684ca1f-d632-4d5f-bf33-3b918e286e10 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.439982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684ca1f-d632-4d5f-bf33-3b918e286e10 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.456428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.457140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.457417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.457720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.458461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.460189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.472257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] The token cache is being invalidate because project b8afcd3ac1ce428983de300044e4395c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:42.472543 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.478692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-09a052e5-58db-4721-88cf-3b3e2c960ea4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:42.479045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1028/2051] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:42.479137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1024/2052] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:42 2022] DELETE /identity/v3/projects/b8afcd3ac1ce428983de300044e4395c => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:42.479253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.487706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.487886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97f50-ae5c-4b03-87b6-b554ed895e2c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.487886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97f50-ae5c-4b03-87b6-b554ed895e2c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.487886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97f50-ae5c-4b03-87b6-b554ed895e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.502426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf39245-08f3-45cf-9e6a-81503a597182 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.508859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e75190-f58c-46ad-acf4-e5e6a762997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.509792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-86b97f50-ae5c-4b03-87b6-b554ed895e2c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:42.509947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75190-f58c-46ad-acf4-e5e6a762997a admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.510222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75190-f58c-46ad-acf4-e5e6a762997a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.510463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e75190-f58c-46ad-acf4-e5e6a762997a admin admin] PATH_INFO: `/v3/projects/42a19c7003dc4a89935350cf87741dda/users/3ecf769f9e614691bda11876dc5fae71/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.511713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-86b97f50-ae5c-4b03-87b6-b554ed895e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.531335 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1025/2053] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:42.534308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e75190-f58c-46ad-acf4-e5e6a762997a admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a19c7003dc4a89935350cf87741dda, user_id=3ecf769f9e614691bda11876dc5fae71, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.541286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b027c28-cb61-46af-af6e-a0f22bffa78c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.541568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b027c28-cb61-46af-af6e-a0f22bffa78c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.542191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b027c28-cb61-46af-af6e-a0f22bffa78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.543872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e75190-f58c-46ad-acf4-e5e6a762997a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.571874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:42.573123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0b027c28-cb61-46af-af6e-a0f22bffa78c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:42.574716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0b027c28-cb61-46af-af6e-a0f22bffa78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.582976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1026/2054] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:42.587576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b027c28-cb61-46af-af6e-a0f22bffa78c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.607081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b027c28-cb61-46af-af6e-a0f22bffa78c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.614042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864405fc-4974-4883-b92c-ca036b30170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.614887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864405fc-4974-4883-b92c-ca036b30170b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.615347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864405fc-4974-4883-b92c-ca036b30170b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.615783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864405fc-4974-4883-b92c-ca036b30170b admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.617140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864405fc-4974-4883-b92c-ca036b30170b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:42.617453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864405fc-4974-4883-b92c-ca036b30170b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.619186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864405fc-4974-4883-b92c-ca036b30170b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.637716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1029/2055] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:42 2022] PUT /identity/v3/projects/42a19c7003dc4a89935350cf87741dda/users/3ecf769f9e614691bda11876dc5fae71/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:42.639309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1027/2056] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:48:42.647254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e75190-f58c-46ad-acf4-e5e6a762997a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.656781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038e69-44c1-4f74-97d3-1cb0d994efb4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.657398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038e69-44c1-4f74-97d3-1cb0d994efb4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.657686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12038e69-44c1-4f74-97d3-1cb0d994efb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.707401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-12038e69-44c1-4f74-97d3-1cb0d994efb4 None None] MFA Rules not processed for user `3ecf769f9e614691bda11876dc5fae71`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:42.708651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-12038e69-44c1-4f74-97d3-1cb0d994efb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:42.742171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e75190-f58c-46ad-acf4-e5e6a762997a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.752465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ade011-0a46-4604-a4a7-1f3c245827ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.753767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade011-0a46-4604-a4a7-1f3c245827ed admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.755376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade011-0a46-4604-a4a7-1f3c245827ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.759849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ade011-0a46-4604-a4a7-1f3c245827ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.759849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ade011-0a46-4604-a4a7-1f3c245827ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.760982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ade011-0a46-4604-a4a7-1f3c245827ed admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.786231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1028/2057] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:42.791523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038e69-44c1-4f74-97d3-1cb0d994efb4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.802569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12038e69-44c1-4f74-97d3-1cb0d994efb4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:42.813508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:42.814303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:42.814622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:42.814909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:42.815624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:42.819059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:42.919667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1030/2058] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:42 2022] POST /identity/v3/projects => generated 371 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:42.923752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ade011-0a46-4604-a4a7-1f3c245827ed admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.965357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1029/2059] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:42 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:42.967308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:42.969131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:43.020706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ade011-0a46-4604-a4a7-1f3c245827ed admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.055638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cdb161-fe70-49cd-9707-6bd7db7e977f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.060490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.071306 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.071750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.072222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] PATH_INFO: `/v3/projects/710d3da9ae51493d8a737a3d0d5f20d0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.074052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=710d3da9ae51493d8a737a3d0d5f20d0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.077179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.099529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700c40-9bdc-4e1b-a8fd-2636359e187a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.100386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700c40-9bdc-4e1b-a8fd-2636359e187a admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.100730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700c40-9bdc-4e1b-a8fd-2636359e187a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.101081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700c40-9bdc-4e1b-a8fd-2636359e187a admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.101829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700c40-9bdc-4e1b-a8fd-2636359e187a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.104786 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700c40-9bdc-4e1b-a8fd-2636359e187a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.304430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1031/2060] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:42 2022] POST /identity/v3/users => generated 286 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:43.304430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700c40-9bdc-4e1b-a8fd-2636359e187a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.310401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '710d3da9ae51493d8a737a3d0d5f20d0', 'request_id': 'req-ee65eda0-ddd5-4215-9b52-ea4f32903912'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:43.313113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700c40-9bdc-4e1b-a8fd-2636359e187a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.318879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '710d3da9ae51493d8a737a3d0d5f20d0', 'request_id': 'req-ee65eda0-ddd5-4215-9b52-ea4f32903912'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:43.324908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '710d3da9ae51493d8a737a3d0d5f20d0', 'request_id': 'req-ee65eda0-ddd5-4215-9b52-ea4f32903912'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:43.375599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff84b6d-b463-47da-a215-c4d8ac05da9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.376286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84b6d-b463-47da-a215-c4d8ac05da9d admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.376571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84b6d-b463-47da-a215-c4d8ac05da9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.376849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff84b6d-b463-47da-a215-c4d8ac05da9d admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.377670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff84b6d-b463-47da-a215-c4d8ac05da9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.379693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff84b6d-b463-47da-a215-c4d8ac05da9d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.493619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] The token cache is being invalidate because project 710d3da9ae51493d8a737a3d0d5f20d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:43.493905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:43.494638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:43.498503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1030/2061] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:42 2022] DELETE /identity/v3/projects/710d3da9ae51493d8a737a3d0d5f20d0 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:43.498503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.498503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:43.511636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65eda0-ddd5-4215-9b52-ea4f32903912 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.516268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8de4e-4771-45c2-86ce-11b1b5ffb79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.516946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8de4e-4771-45c2-86ce-11b1b5ffb79a admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.517233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8de4e-4771-45c2-86ce-11b1b5ffb79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.517514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8de4e-4771-45c2-86ce-11b1b5ffb79a admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.518245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8de4e-4771-45c2-86ce-11b1b5ffb79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.519903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8de4e-4771-45c2-86ce-11b1b5ffb79a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.530709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1031/2062] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:43.531835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b208-2680-49bc-b0f6-0df3b9273976 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.532127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b208-2680-49bc-b0f6-0df3b9273976 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.532412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b106b208-2680-49bc-b0f6-0df3b9273976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.535512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1032/2063] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:43 2022] POST /identity/v3/users => generated 292 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:43.536245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff84b6d-b463-47da-a215-c4d8ac05da9d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.548077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff84b6d-b463-47da-a215-c4d8ac05da9d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.552708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b106b208-2680-49bc-b0f6-0df3b9273976 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:43.552853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818e4bb-2776-49ee-b4c0-cdd7181841a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.554266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818e4bb-2776-49ee-b4c0-cdd7181841a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.554487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818e4bb-2776-49ee-b4c0-cdd7181841a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.554787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818e4bb-2776-49ee-b4c0-cdd7181841a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.555171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b106b208-2680-49bc-b0f6-0df3b9273976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:43.555517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818e4bb-2776-49ee-b4c0-cdd7181841a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.557113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818e4bb-2776-49ee-b4c0-cdd7181841a4 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.563666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1032/2064] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:43.564298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b208-2680-49bc-b0f6-0df3b9273976 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.567941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1033/2065] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:43.574588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b106b208-2680-49bc-b0f6-0df3b9273976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:43.574718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73ca0-9fae-49bb-9261-103b32a477a6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.574718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73ca0-9fae-49bb-9261-103b32a477a6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.574718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d73ca0-9fae-49bb-9261-103b32a477a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.586007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b106b208-2680-49bc-b0f6-0df3b9273976 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.591076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa292d-1d73-4c74-8ab2-9b7bd1266803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.591787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa292d-1d73-4c74-8ab2-9b7bd1266803 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.592002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-57d73ca0-9fae-49bb-9261-103b32a477a6 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:43.592130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa292d-1d73-4c74-8ab2-9b7bd1266803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.592330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa292d-1d73-4c74-8ab2-9b7bd1266803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.593056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa292d-1d73-4c74-8ab2-9b7bd1266803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.593242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-57d73ca0-9fae-49bb-9261-103b32a477a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:43.597750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa292d-1d73-4c74-8ab2-9b7bd1266803 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.608418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1034/2066] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:43.608418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d73ca0-9fae-49bb-9261-103b32a477a6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.613575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1033/2067] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:43.614573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa292d-1d73-4c74-8ab2-9b7bd1266803 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.616334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d73ca0-9fae-49bb-9261-103b32a477a6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.621542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc0405-6dd2-4495-bece-9d00a96e394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.622473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0405-6dd2-4495-bece-9d00a96e394a admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.622784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0405-6dd2-4495-bece-9d00a96e394a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.623054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc0405-6dd2-4495-bece-9d00a96e394a admin admin] PATH_INFO: `/v3/projects/c54f76e126c44c31a47681124cc50b3a/users/b294922c392540ada3883203cb41e1d2/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.625172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:43.629753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa292d-1d73-4c74-8ab2-9b7bd1266803 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.634706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.635593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.635938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.636278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.637098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:43.637470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.639426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.640356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc0405-6dd2-4495-bece-9d00a96e394a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54f76e126c44c31a47681124cc50b3a, user_id=b294922c392540ada3883203cb41e1d2, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.643058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc0405-6dd2-4495-bece-9d00a96e394a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.661478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1034/2068] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:43.662802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.674758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996299e1-fd3a-4202-a016-109ffc1709db admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.680237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c32f82-1726-4cd2-808e-58f4af03f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.681011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c32f82-1726-4cd2-808e-58f4af03f1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.681456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c32f82-1726-4cd2-808e-58f4af03f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.681755 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c32f82-1726-4cd2-808e-58f4af03f1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.682463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c32f82-1726-4cd2-808e-58f4af03f1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.684173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c32f82-1726-4cd2-808e-58f4af03f1ab admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.694880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1035/2069] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:43.695741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c32f82-1726-4cd2-808e-58f4af03f1ab admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.705471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c32f82-1726-4cd2-808e-58f4af03f1ab admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.711217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a1dd04-22e7-41f7-a3c8-b2120d5ebba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.712052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1dd04-22e7-41f7-a3c8-b2120d5ebba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.712318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1dd04-22e7-41f7-a3c8-b2120d5ebba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.712597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a1dd04-22e7-41f7-a3c8-b2120d5ebba5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.713296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1dd04-22e7-41f7-a3c8-b2120d5ebba5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.715285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a1dd04-22e7-41f7-a3c8-b2120d5ebba5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.746687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1035/2070] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:43 2022] PUT /identity/v3/projects/c54f76e126c44c31a47681124cc50b3a/users/b294922c392540ada3883203cb41e1d2/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:43.747707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc0405-6dd2-4495-bece-9d00a96e394a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.813081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc0405-6dd2-4495-bece-9d00a96e394a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.818291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.819257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.819530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.819797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] PATH_INFO: `/v3/projects/b20a437adcb44605bd37bec1b5159871/users/d65bdb7c3cd04af5bca8c647f1c53996/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.837116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20a437adcb44605bd37bec1b5159871, user_id=d65bdb7c3cd04af5bca8c647f1c53996, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.839741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.845583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1036/2071] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:43 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:43.847242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8534e0-cf1c-45fb-96c7-bc589073d937 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.847531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8534e0-cf1c-45fb-96c7-bc589073d937 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.847808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8534e0-cf1c-45fb-96c7-bc589073d937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.873056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5a8534e0-cf1c-45fb-96c7-bc589073d937 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:43.874318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5a8534e0-cf1c-45fb-96c7-bc589073d937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:43.934750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:43.938650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1037/2072] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:43.939478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8534e0-cf1c-45fb-96c7-bc589073d937 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.949154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8534e0-cf1c-45fb-96c7-bc589073d937 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:43.953838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f784e-63df-4fb9-ace8-dfb4f02b6059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:43.954506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f784e-63df-4fb9-ace8-dfb4f02b6059 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:43.954855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f784e-63df-4fb9-ace8-dfb4f02b6059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:43.955132 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f784e-63df-4fb9-ace8-dfb4f02b6059 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:43.955941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f784e-63df-4fb9-ace8-dfb4f02b6059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:43.957899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f784e-63df-4fb9-ace8-dfb4f02b6059 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:43.963862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1036/2073] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:43 2022] PUT /identity/v3/projects/b20a437adcb44605bd37bec1b5159871/users/d65bdb7c3cd04af5bca8c647f1c53996/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:43.965768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:43.971418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:44.033521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c7d98-cd80-4a03-9001-2b557c3b0ea2 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.038291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759c215-dffd-4ab8-acb7-7cc86d96fa62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.038983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759c215-dffd-4ab8-acb7-7cc86d96fa62 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.039266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759c215-dffd-4ab8-acb7-7cc86d96fa62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.039538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759c215-dffd-4ab8-acb7-7cc86d96fa62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.051368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1038/2074] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:43 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:44.057560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c70ce-da4d-4d9c-90f7-2b27186fd02b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.057560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c70ce-da4d-4d9c-90f7-2b27186fd02b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.057560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c70ce-da4d-4d9c-90f7-2b27186fd02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.087690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e28c70ce-da4d-4d9c-90f7-2b27186fd02b None None] MFA Rules not processed for user `d65bdb7c3cd04af5bca8c647f1c53996`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:44.088822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e28c70ce-da4d-4d9c-90f7-2b27186fd02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:44.106613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759c215-dffd-4ab8-acb7-7cc86d96fa62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.108069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6759c215-dffd-4ab8-acb7-7cc86d96fa62 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.121363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1037/2075] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:44.122211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759c215-dffd-4ab8-acb7-7cc86d96fa62 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.133051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759c215-dffd-4ab8-acb7-7cc86d96fa62 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.139275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520013-4063-4c7c-8cac-7d3bf85a2c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.140277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520013-4063-4c7c-8cac-7d3bf85a2c1a admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.140550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520013-4063-4c7c-8cac-7d3bf85a2c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.140827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70520013-4063-4c7c-8cac-7d3bf85a2c1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.141563 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70520013-4063-4c7c-8cac-7d3bf85a2c1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.143753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70520013-4063-4c7c-8cac-7d3bf85a2c1a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.154925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1038/2076] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:44.164286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520013-4063-4c7c-8cac-7d3bf85a2c1a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.167731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1039/2077] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:44.172112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c70ce-da4d-4d9c-90f7-2b27186fd02b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.175096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70520013-4063-4c7c-8cac-7d3bf85a2c1a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.180084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71185bc4-298b-448c-ab8b-2fe449b7588b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.180767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71185bc4-298b-448c-ab8b-2fe449b7588b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.181052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71185bc4-298b-448c-ab8b-2fe449b7588b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.181328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71185bc4-298b-448c-ab8b-2fe449b7588b admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.182056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71185bc4-298b-448c-ab8b-2fe449b7588b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.183697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71185bc4-298b-448c-ab8b-2fe449b7588b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.186325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c70ce-da4d-4d9c-90f7-2b27186fd02b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.192554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c426ee-f16d-4328-88bc-c93214684492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.194398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c426ee-f16d-4328-88bc-c93214684492 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.195412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c426ee-f16d-4328-88bc-c93214684492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.195696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c426ee-f16d-4328-88bc-c93214684492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.196412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c426ee-f16d-4328-88bc-c93214684492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.196848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1039/2078] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:44.198550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c426ee-f16d-4328-88bc-c93214684492 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.208858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71185bc4-298b-448c-ab8b-2fe449b7588b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.221875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71185bc4-298b-448c-ab8b-2fe449b7588b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.228334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87e39b6-e066-454b-adc6-218aab74e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.229633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e39b6-e066-454b-adc6-218aab74e38f admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.230074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e39b6-e066-454b-adc6-218aab74e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.230662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87e39b6-e066-454b-adc6-218aab74e38f admin admin] PATH_INFO: `/v3/projects/cb51a6a012b6428a9c7fe94ab36de1c5/users/ec678662fe6f4a28ace23b0255a99286/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.248212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e39b6-e066-454b-adc6-218aab74e38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb51a6a012b6428a9c7fe94ab36de1c5, user_id=ec678662fe6f4a28ace23b0255a99286, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.250934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87e39b6-e066-454b-adc6-218aab74e38f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.343104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1040/2079] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:44 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:44.343287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1040/2080] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:44 2022] PUT /identity/v3/projects/cb51a6a012b6428a9c7fe94ab36de1c5/users/ec678662fe6f4a28ace23b0255a99286/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:44.346134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c426ee-f16d-4328-88bc-c93214684492 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.354023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f32ddc-8cc2-4730-9bee-69cb4dc8e1a6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.354309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f32ddc-8cc2-4730-9bee-69cb4dc8e1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.354618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f32ddc-8cc2-4730-9bee-69cb4dc8e1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.385760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-59f32ddc-8cc2-4730-9bee-69cb4dc8e1a6 None None] MFA Rules not processed for user `ec678662fe6f4a28ace23b0255a99286`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:44.387021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-59f32ddc-8cc2-4730-9bee-69cb4dc8e1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:44.420039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c426ee-f16d-4328-88bc-c93214684492 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.425031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816c33-7644-4f9c-bc2b-813d976287b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.425705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816c33-7644-4f9c-bc2b-813d976287b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.425983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816c33-7644-4f9c-bc2b-813d976287b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.426256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a816c33-7644-4f9c-bc2b-813d976287b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.426985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816c33-7644-4f9c-bc2b-813d976287b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.429021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a816c33-7644-4f9c-bc2b-813d976287b3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.455056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1041/2081] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:44.459204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f32ddc-8cc2-4730-9bee-69cb4dc8e1a6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.470853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f32ddc-8cc2-4730-9bee-69cb4dc8e1a6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.477421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221eafd-6224-42fb-8535-4211cd9c88c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.478099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221eafd-6224-42fb-8535-4211cd9c88c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.478382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221eafd-6224-42fb-8535-4211cd9c88c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.478716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221eafd-6224-42fb-8535-4211cd9c88c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.479419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221eafd-6224-42fb-8535-4211cd9c88c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.481336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221eafd-6224-42fb-8535-4211cd9c88c3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.533007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1041/2082] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:44 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:44.534242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816c33-7644-4f9c-bc2b-813d976287b3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.548694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a816c33-7644-4f9c-bc2b-813d976287b3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.553924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629837a-f098-4b61-970c-9c71ea8d5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.554813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629837a-f098-4b61-970c-9c71ea8d5c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.555110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629837a-f098-4b61-970c-9c71ea8d5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.555379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629837a-f098-4b61-970c-9c71ea8d5c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.556118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629837a-f098-4b61-970c-9c71ea8d5c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.557704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4629837a-f098-4b61-970c-9c71ea8d5c67 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.568284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1042/2083] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:44.574019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629837a-f098-4b61-970c-9c71ea8d5c67 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.583780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629837a-f098-4b61-970c-9c71ea8d5c67 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.589233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa402-5e19-4e4c-9cba-f531f2f3a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.590117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa402-5e19-4e4c-9cba-f531f2f3a31c admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.590450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa402-5e19-4e4c-9cba-f531f2f3a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.590757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfa402-5e19-4e4c-9cba-f531f2f3a31c admin admin] PATH_INFO: `/v3/projects/1c3e221a66ba44438660caa3c5379564/users/4480c38b17dd4dd1b227e053ee385937/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.610785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfa402-5e19-4e4c-9cba-f531f2f3a31c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3e221a66ba44438660caa3c5379564, user_id=4480c38b17dd4dd1b227e053ee385937, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.615044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfa402-5e19-4e4c-9cba-f531f2f3a31c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.635107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1042/2084] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:44 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:44.637177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221eafd-6224-42fb-8535-4211cd9c88c3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.704618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221eafd-6224-42fb-8535-4211cd9c88c3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.710469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8eb13-e739-4813-b615-8d1a6818e96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.711310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8eb13-e739-4813-b615-8d1a6818e96a admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.711591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8eb13-e739-4813-b615-8d1a6818e96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.711864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8eb13-e739-4813-b615-8d1a6818e96a admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.712570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8eb13-e739-4813-b615-8d1a6818e96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.714509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8eb13-e739-4813-b615-8d1a6818e96a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.731043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1043/2085] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:44 2022] PUT /identity/v3/projects/1c3e221a66ba44438660caa3c5379564/users/4480c38b17dd4dd1b227e053ee385937/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:44.734923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa402-5e19-4e4c-9cba-f531f2f3a31c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.801404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfa402-5e19-4e4c-9cba-f531f2f3a31c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.809833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b67f-9588-448f-b099-388e7358a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.810794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b67f-9588-448f-b099-388e7358a49b admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.812729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b67f-9588-448f-b099-388e7358a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.813818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7b67f-9588-448f-b099-388e7358a49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.814796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7b67f-9588-448f-b099-388e7358a49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.816635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7b67f-9588-448f-b099-388e7358a49b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.841671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1043/2086] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:44 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:44.842254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1044/2087] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:48:44.842888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8eb13-e739-4813-b615-8d1a6818e96a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.843557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b67f-9588-448f-b099-388e7358a49b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.856114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7b67f-9588-448f-b099-388e7358a49b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.860480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8eb13-e739-4813-b615-8d1a6818e96a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.861217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbda78-1573-413b-b3a2-7b019e6c6ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.861907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbda78-1573-413b-b3a2-7b019e6c6ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.862390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbda78-1573-413b-b3a2-7b019e6c6ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.862662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fbda78-1573-413b-b3a2-7b019e6c6ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.863403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbda78-1573-413b-b3a2-7b019e6c6ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.865629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fbda78-1573-413b-b3a2-7b019e6c6ec8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.867184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e73729-d861-4714-b35b-15524477a783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.868787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e73729-d861-4714-b35b-15524477a783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.869242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e73729-d861-4714-b35b-15524477a783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.869737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e73729-d861-4714-b35b-15524477a783 admin admin] PATH_INFO: `/v3/projects/1c3e221a66ba44438660caa3c5379564/users/4480c38b17dd4dd1b227e053ee385937/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.872603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e73729-d861-4714-b35b-15524477a783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3e221a66ba44438660caa3c5379564, user_id=4480c38b17dd4dd1b227e053ee385937, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:44.875576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e73729-d861-4714-b35b-15524477a783 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:44.878610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1045/2088] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:44.891098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1044/2089] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:44 2022] PUT /identity/v3/projects/1c3e221a66ba44438660caa3c5379564/users/4480c38b17dd4dd1b227e053ee385937/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:44.891770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbda78-1573-413b-b3a2-7b019e6c6ec8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:44.902231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5a98-e837-47eb-8a04-03adfcfee8b6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.902372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5a98-e837-47eb-8a04-03adfcfee8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.902677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee5a98-e837-47eb-8a04-03adfcfee8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.905337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fbda78-1573-413b-b3a2-7b019e6c6ec8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:44.932475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-2aee5a98-e837-47eb-8a04-03adfcfee8b6 None None] MFA Rules not processed for user `4480c38b17dd4dd1b227e053ee385937`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:44.933691 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2aee5a98-e837-47eb-8a04-03adfcfee8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:44.983061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2ff95-b731-41b3-a43d-4d39578107a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:44.984044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2ff95-b731-41b3-a43d-4d39578107a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:44.984321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2ff95-b731-41b3-a43d-4d39578107a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:44.984593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2ff95-b731-41b3-a43d-4d39578107a1 admin admin] PATH_INFO: `/v3/projects/e07cc9adf2d04ddfbf5e07aa2108ec9b/users/cc544c2b524948f2b3407b5d10f7cf4a/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:44.999703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2ff95-b731-41b3-a43d-4d39578107a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07cc9adf2d04ddfbf5e07aa2108ec9b, user_id=cc544c2b524948f2b3407b5d10f7cf4a, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.002548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb2ff95-b731-41b3-a43d-4d39578107a1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.014869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1045/2090] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:45.029094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee5a98-e837-47eb-8a04-03adfcfee8b6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.030710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2aee5a98-e837-47eb-8a04-03adfcfee8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:45.083101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1046/2091] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:44 2022] PUT /identity/v3/projects/e07cc9adf2d04ddfbf5e07aa2108ec9b/users/cc544c2b524948f2b3407b5d10f7cf4a/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:45.085196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2ff95-b731-41b3-a43d-4d39578107a1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.110794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee5a98-e837-47eb-8a04-03adfcfee8b6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.167437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2ff95-b731-41b3-a43d-4d39578107a1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.169916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.170598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.170882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.171215 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.172378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb87d55-0c01-454a-adfe-aabc5a259de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.173099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:45.173210 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb87d55-0c01-454a-adfe-aabc5a259de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.173371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb87d55-0c01-454a-adfe-aabc5a259de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.173653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb87d55-0c01-454a-adfe-aabc5a259de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.174566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb87d55-0c01-454a-adfe-aabc5a259de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.177043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb87d55-0c01-454a-adfe-aabc5a259de5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.192934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1047/2092] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:45.195972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb87d55-0c01-454a-adfe-aabc5a259de5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.208593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb87d55-0c01-454a-adfe-aabc5a259de5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.218795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619ee8-9de7-4f8d-a879-7ceeedaf7a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.218795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619ee8-9de7-4f8d-a879-7ceeedaf7a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.218795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619ee8-9de7-4f8d-a879-7ceeedaf7a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.218795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619ee8-9de7-4f8d-a879-7ceeedaf7a63 admin admin] PATH_INFO: `/v3/projects/e07cc9adf2d04ddfbf5e07aa2108ec9b/users/cc544c2b524948f2b3407b5d10f7cf4a/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.219141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64619ee8-9de7-4f8d-a879-7ceeedaf7a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07cc9adf2d04ddfbf5e07aa2108ec9b, user_id=cc544c2b524948f2b3407b5d10f7cf4a, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.221473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64619ee8-9de7-4f8d-a879-7ceeedaf7a63 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.233484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1048/2093] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:45 2022] PUT /identity/v3/projects/e07cc9adf2d04ddfbf5e07aa2108ec9b/users/cc544c2b524948f2b3407b5d10f7cf4a/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:45.244225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff324e-5682-4c14-94c1-3ce23c8c0edc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.244517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff324e-5682-4c14-94c1-3ce23c8c0edc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.247464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ff324e-5682-4c14-94c1-3ce23c8c0edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.362099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c7ff324e-5682-4c14-94c1-3ce23c8c0edc None None] MFA Rules not processed for user `cc544c2b524948f2b3407b5d10f7cf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:45.363689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c7ff324e-5682-4c14-94c1-3ce23c8c0edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:45.374688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.377464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.392389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1046/2094] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:45.447625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1049/2095] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:45.460766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.462217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:45.472885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a4d32-5c82-4b17-a309-4db2ce85f1a1 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.518487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:45.531099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c201f0-61d1-4ed0-ae42-2936ebe87f6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.531758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c201f0-61d1-4ed0-ae42-2936ebe87f6c service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.532034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c201f0-61d1-4ed0-ae42-2936ebe87f6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.532299 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c201f0-61d1-4ed0-ae42-2936ebe87f6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.542644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c201f0-61d1-4ed0-ae42-2936ebe87f6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.544080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c201f0-61d1-4ed0-ae42-2936ebe87f6c service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:45.554080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1047/2096] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:45.775569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d0d4-d767-44d3-9861-783ff27967af None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.779099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d0d4-d767-44d3-9861-783ff27967af None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.779099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d0d4-d767-44d3-9861-783ff27967af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.815612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9e80d0d4-d767-44d3-9861-783ff27967af None None] MFA Rules not processed for user `b294922c392540ada3883203cb41e1d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:45.815612 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9e80d0d4-d767-44d3-9861-783ff27967af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:45.893851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1050/2097] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:45.899965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c201f0-61d1-4ed0-ae42-2936ebe87f6c service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:45.976116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c201f0-61d1-4ed0-ae42-2936ebe87f6c service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:45.980652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad45bd7-696b-40e0-9485-c7c1e0d3d554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:45.981307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad45bd7-696b-40e0-9485-c7c1e0d3d554 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:45.981586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad45bd7-696b-40e0-9485-c7c1e0d3d554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:45.981861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad45bd7-696b-40e0-9485-c7c1e0d3d554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:45.982576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad45bd7-696b-40e0-9485-c7c1e0d3d554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:45.984528 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad45bd7-696b-40e0-9485-c7c1e0d3d554 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:46.127082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1048/2098] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:45 2022] POST /identity/v3/projects => generated 373 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:46.128258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d0d4-d767-44d3-9861-783ff27967af None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:46.141986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d0d4-d767-44d3-9861-783ff27967af None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:46.203260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=18,keystone:SELECT=81,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:46.211385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfef3a-ad50-4de9-bc78-059e899c8974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:46.212065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfef3a-ad50-4de9-bc78-059e899c8974 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:46.212365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfef3a-ad50-4de9-bc78-059e899c8974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:46.212634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfef3a-ad50-4de9-bc78-059e899c8974 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:46.216349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfef3a-ad50-4de9-bc78-059e899c8974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:46.216349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edfef3a-ad50-4de9-bc78-059e899c8974 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:46.458873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1051/2099] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:46 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:46.463288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad45bd7-696b-40e0-9485-c7c1e0d3d554 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:46.473633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad45bd7-696b-40e0-9485-c7c1e0d3d554 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:46.478944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ef301-d382-4fa6-982a-c6a9eb5c9660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:46.479621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ef301-d382-4fa6-982a-c6a9eb5c9660 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:46.479898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ef301-d382-4fa6-982a-c6a9eb5c9660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:46.480168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ef301-d382-4fa6-982a-c6a9eb5c9660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:46.480993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ef301-d382-4fa6-982a-c6a9eb5c9660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:46.483093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ef301-d382-4fa6-982a-c6a9eb5c9660 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:46.496047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1049/2100] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:46.500406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfef3a-ad50-4de9-bc78-059e899c8974 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:46.511184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfef3a-ad50-4de9-bc78-059e899c8974 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:46.517451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5cfd8-4e9f-4872-b6b4-827f8e9c26fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:46.518361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5cfd8-4e9f-4872-b6b4-827f8e9c26fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:46.518681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5cfd8-4e9f-4872-b6b4-827f8e9c26fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:46.518961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5cfd8-4e9f-4872-b6b4-827f8e9c26fe admin admin] PATH_INFO: `/v3/projects/578b43874bb54c5dad3c417c58a3f3c3/users/332f208dd55b42f5a5de9ce0029cd63a/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:46.535741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5cfd8-4e9f-4872-b6b4-827f8e9c26fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=578b43874bb54c5dad3c417c58a3f3c3, user_id=332f208dd55b42f5a5de9ce0029cd63a, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:46.539753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5cfd8-4e9f-4872-b6b4-827f8e9c26fe admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:46.630647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1052/2101] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:46 2022] PUT /identity/v3/projects/578b43874bb54c5dad3c417c58a3f3c3/users/332f208dd55b42f5a5de9ce0029cd63a/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:46.634752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ef301-d382-4fa6-982a-c6a9eb5c9660 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:46.644950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ef301-d382-4fa6-982a-c6a9eb5c9660 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:46.706092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4d42a-cbae-4583-90c0-ee86f735d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:46.706794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4d42a-cbae-4583-90c0-ee86f735d78d admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:46.707077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4d42a-cbae-4583-90c0-ee86f735d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:46.707351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4d42a-cbae-4583-90c0-ee86f735d78d admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:46.708077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4d42a-cbae-4583-90c0-ee86f735d78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:46.710396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4d42a-cbae-4583-90c0-ee86f735d78d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:46.720974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1050/2102] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:46.728844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5cfd8-4e9f-4872-b6b4-827f8e9c26fe admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:46.739519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5cfd8-4e9f-4872-b6b4-827f8e9c26fe admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:46.744807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11709c-e1a2-49cf-b330-5464e9820214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:46.745728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11709c-e1a2-49cf-b330-5464e9820214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:46.746010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11709c-e1a2-49cf-b330-5464e9820214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:46.746285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11709c-e1a2-49cf-b330-5464e9820214 admin admin] PATH_INFO: `/v3/projects/578b43874bb54c5dad3c417c58a3f3c3/users/332f208dd55b42f5a5de9ce0029cd63a/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:46.748353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11709c-e1a2-49cf-b330-5464e9820214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578b43874bb54c5dad3c417c58a3f3c3, user_id=332f208dd55b42f5a5de9ce0029cd63a, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:46.751058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11709c-e1a2-49cf-b330-5464e9820214 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:46.762333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1053/2103] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:46 2022] PUT /identity/v3/projects/578b43874bb54c5dad3c417c58a3f3c3/users/332f208dd55b42f5a5de9ce0029cd63a/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:46.865206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4d42a-cbae-4583-90c0-ee86f735d78d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:46.933905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4d42a-cbae-4583-90c0-ee86f735d78d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:46.994298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc544c2b524948f2b3407b5d10f7cf4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e07cc9adf2d04ddfbf5e07aa2108ec9b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:46.995011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:46.995296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:46.995574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:46.996305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:46.996620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:46.998211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:47.010370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1051/2104] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:47.014720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11709c-e1a2-49cf-b330-5464e9820214 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:47.027404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11709c-e1a2-49cf-b330-5464e9820214 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:47.032285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c96a0-755e-43db-aa5f-084e06a2ba5d tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc544c2b524948f2b3407b5d10f7cf4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e07cc9adf2d04ddfbf5e07aa2108ec9b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:47.032936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c96a0-755e-43db-aa5f-084e06a2ba5d tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:47.033318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c96a0-755e-43db-aa5f-084e06a2ba5d tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:47.033501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c96a0-755e-43db-aa5f-084e06a2ba5d tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:47.034194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c96a0-755e-43db-aa5f-084e06a2ba5d tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:47.036334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c96a0-755e-43db-aa5f-084e06a2ba5d tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:47.148456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1054/2105] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:47 2022] POST /identity/v3/projects => generated 355 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:47.152974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:47.165987 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46d8c-706a-498b-9ad6-db41ceea8aca tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:47.235056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a9a30-6d10-4359-96b4-470d289ab393 tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc544c2b524948f2b3407b5d10f7cf4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e07cc9adf2d04ddfbf5e07aa2108ec9b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:47.235740 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9a30-6d10-4359-96b4-470d289ab393 tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:47.236028 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9a30-6d10-4359-96b4-470d289ab393 tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:47.236309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a9a30-6d10-4359-96b4-470d289ab393 tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:47.237053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a9a30-6d10-4359-96b4-470d289ab393 tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:47.237364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a9a30-6d10-4359-96b4-470d289ab393 tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:47.239116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a9a30-6d10-4359-96b4-470d289ab393 tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:47.256096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1052/2106] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:47.311461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c96a0-755e-43db-aa5f-084e06a2ba5d tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:47.323089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c96a0-755e-43db-aa5f-084e06a2ba5d tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:47.327915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc544c2b524948f2b3407b5d10f7cf4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e07cc9adf2d04ddfbf5e07aa2108ec9b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:47.330334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:47.330334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:47.330334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] PATH_INFO: `/v3/projects/879107de669e4bfeb61503ecaa39d853` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:47.330671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Authorizing `identity:delete_project(project_id=879107de669e4bfeb61503ecaa39d853)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:47.332518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:47.361784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:47.495298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879107de669e4bfeb61503ecaa39d853', 'request_id': 'req-081cf045-1583-42e6-aaf4-c954c3fce2ea'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:47.501646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879107de669e4bfeb61503ecaa39d853', 'request_id': 'req-081cf045-1583-42e6-aaf4-c954c3fce2ea'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:47.508330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879107de669e4bfeb61503ecaa39d853', 'request_id': 'req-081cf045-1583-42e6-aaf4-c954c3fce2ea'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:47.614545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] The token cache is being invalidate because project 879107de669e4bfeb61503ecaa39d853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:47.614853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:47.615503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:47.617723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1055/2107] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:47 2022] DELETE /identity/v3/projects/879107de669e4bfeb61503ecaa39d853 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:48.165060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:48.179537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e0f3b-dd41-42cd-96fd-d856f931c81b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:48.180080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e0f3b-dd41-42cd-96fd-d856f931c81b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:48.180469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e0f3b-dd41-42cd-96fd-d856f931c81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:48.227710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b11e0f3b-dd41-42cd-96fd-d856f931c81b None None] MFA Rules not processed for user `332f208dd55b42f5a5de9ce0029cd63a`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:48.229162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b11e0f3b-dd41-42cd-96fd-d856f931c81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:48.333539 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:48.337816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:48.361722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1053/2108] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:48.374949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e0f3b-dd41-42cd-96fd-d856f931c81b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:48.376731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b11e0f3b-dd41-42cd-96fd-d856f931c81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:48.455931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081cf045-1583-42e6-aaf4-c954c3fce2ea tempest-VolumeQuotaClassesTest-1403695177 tempest-VolumeQuotaClassesTest-1403695177-project-admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:48.462067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e0f3b-dd41-42cd-96fd-d856f931c81b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:48.462235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:48.463199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:48.463697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:48.464283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] PATH_INFO: `/v3/users/ec678662fe6f4a28ace23b0255a99286` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:48.466472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec678662fe6f4a28ace23b0255a99286)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:48.466638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067cb4a5-63e1-49c1-83a5-7fc1d4414dc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:48.467235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb4a5-63e1-49c1-83a5-7fc1d4414dc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:48.467560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb4a5-63e1-49c1-83a5-7fc1d4414dc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:48.467835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067cb4a5-63e1-49c1-83a5-7fc1d4414dc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:48.469338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:48.471206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-067cb4a5-63e1-49c1-83a5-7fc1d4414dc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:48.509968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:48.562291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cb4a5-63e1-49c1-83a5-7fc1d4414dc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:48.564748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067cb4a5-63e1-49c1-83a5-7fc1d4414dc2 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:48.578160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1054/2109] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:48.701736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec678662fe6f4a28ace23b0255a99286'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:48.702433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec678662fe6f4a28ace23b0255a99286'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:48.703210 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec678662fe6f4a28ace23b0255a99286'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:48.715173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec678662fe6f4a28ace23b0255a99286'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:48.721857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec678662fe6f4a28ace23b0255a99286'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:48.803013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1056/2110] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:48 2022] DELETE /identity/v3/users/ec678662fe6f4a28ace23b0255a99286 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:48.808439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b590f-dd6c-496a-8825-7f3f726667ec None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:48.808725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b590f-dd6c-496a-8825-7f3f726667ec None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:48.809339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b590f-dd6c-496a-8825-7f3f726667ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:48.840173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e73b590f-dd6c-496a-8825-7f3f726667ec None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:48.841416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e73b590f-dd6c-496a-8825-7f3f726667ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:48.907772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1055/2111] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:48.918911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:48.920313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:49.000865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39de5d-a5b8-47e5-8f57-5ba4f20e2d61 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:49.004431 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08188da5-9bea-49f5-9be7-cee36ee3264a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:49.005089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08188da5-9bea-49f5-9be7-cee36ee3264a service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.005373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08188da5-9bea-49f5-9be7-cee36ee3264a service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.005648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08188da5-9bea-49f5-9be7-cee36ee3264a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.015035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08188da5-9bea-49f5-9be7-cee36ee3264a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:49.021767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08188da5-9bea-49f5-9be7-cee36ee3264a service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:49.026629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1057/2112] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:49.473015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b590f-dd6c-496a-8825-7f3f726667ec None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:49.475187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e73b590f-dd6c-496a-8825-7f3f726667ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:49.490030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b590f-dd6c-496a-8825-7f3f726667ec None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:49.496308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:49.497524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.498107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.498735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] PATH_INFO: `/v3/projects/cb51a6a012b6428a9c7fe94ab36de1c5` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.500462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb51a6a012b6428a9c7fe94ab36de1c5)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:49.502718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:49.535209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:49.697073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb51a6a012b6428a9c7fe94ab36de1c5', 'request_id': 'req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:49.705055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb51a6a012b6428a9c7fe94ab36de1c5', 'request_id': 'req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:49.837300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb51a6a012b6428a9c7fe94ab36de1c5', 'request_id': 'req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:49.849809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] The token cache is being invalidate because project cb51a6a012b6428a9c7fe94ab36de1c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:49.850093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:49.851413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:49.853033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1056/2113] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:49 2022] DELETE /identity/v3/projects/cb51a6a012b6428a9c7fe94ab36de1c5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:49.857104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08188da5-9bea-49f5-9be7-cee36ee3264a service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:49.867339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08188da5-9bea-49f5-9be7-cee36ee3264a service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:49.929681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:49.930626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:49.930919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:49.931319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] PATH_INFO: `/v3/users/cc544c2b524948f2b3407b5d10f7cf4a` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:49.932452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc544c2b524948f2b3407b5d10f7cf4a)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:49.934421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:49.941079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:50.114021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc544c2b524948f2b3407b5d10f7cf4a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:50.114642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc544c2b524948f2b3407b5d10f7cf4a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:50.115239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc544c2b524948f2b3407b5d10f7cf4a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:50.127832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc544c2b524948f2b3407b5d10f7cf4a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:50.136090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-fdd67201-8fc3-413d-b741-00d7284721a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc544c2b524948f2b3407b5d10f7cf4a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:50.236064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1058/2114] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:48:49 2022] DELETE /identity/v3/users/cc544c2b524948f2b3407b5d10f7cf4a => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:50.574679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:50.751507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:50.752984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:50.766821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c805ee-e1f2-461f-94c7-f77abb1cc2a3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:50.833435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:50.834341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:50.834655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:50.835041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] PATH_INFO: `/v3/projects/e07cc9adf2d04ddfbf5e07aa2108ec9b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:50.836958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07cc9adf2d04ddfbf5e07aa2108ec9b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:50.840708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:50.941323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07cc9adf2d04ddfbf5e07aa2108ec9b', 'request_id': 'req-60de5184-4ce6-46a7-b33b-ed7226925f43'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:50.948244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07cc9adf2d04ddfbf5e07aa2108ec9b', 'request_id': 'req-60de5184-4ce6-46a7-b33b-ed7226925f43'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:51.047261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07cc9adf2d04ddfbf5e07aa2108ec9b', 'request_id': 'req-60de5184-4ce6-46a7-b33b-ed7226925f43'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:51.059623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] The token cache is being invalidate because project e07cc9adf2d04ddfbf5e07aa2108ec9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:48:51.059904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:51.060545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-60de5184-4ce6-46a7-b33b-ed7226925f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:48:51.062082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1057/2115] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:48:50 2022] DELETE /identity/v3/projects/e07cc9adf2d04ddfbf5e07aa2108ec9b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:51.067114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8665170-a312-4697-82d8-c766904e15cb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.067595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8665170-a312-4697-82d8-c766904e15cb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.067681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8665170-a312-4697-82d8-c766904e15cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.095441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a8665170-a312-4697-82d8-c766904e15cb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:51.096661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a8665170-a312-4697-82d8-c766904e15cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:51.161223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1059/2116] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:51.170480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ba8b-84a8-4372-8cea-97d6f75bd811 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.170796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ba8b-84a8-4372-8cea-97d6f75bd811 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.171073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a1ba8b-84a8-4372-8cea-97d6f75bd811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.189147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-27a1ba8b-84a8-4372-8cea-97d6f75bd811 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:51.190331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-27a1ba8b-84a8-4372-8cea-97d6f75bd811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:51.198862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1058/2117] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:51.215087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8665170-a312-4697-82d8-c766904e15cb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:51.224776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8665170-a312-4697-82d8-c766904e15cb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:51.230357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:51.231104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.231391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.231669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.232405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:48:51.232747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:51.234419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:51.237983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:51.247450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1060/2118] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:48:51.251724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1ba8b-84a8-4372-8cea-97d6f75bd811 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:51.260819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a1ba8b-84a8-4372-8cea-97d6f75bd811 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:51.265426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d3a2-1ea6-4fc7-91cf-43736d6b4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:51.266095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d3a2-1ea6-4fc7-91cf-43736d6b4f7f admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.266373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d3a2-1ea6-4fc7-91cf-43736d6b4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.266669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454d3a2-1ea6-4fc7-91cf-43736d6b4f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.267352 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454d3a2-1ea6-4fc7-91cf-43736d6b4f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:51.269235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454d3a2-1ea6-4fc7-91cf-43736d6b4f7f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:51.345813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:51.397923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1059/2119] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:51 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:51.403178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:51.413262 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ace62c-c2f7-4d27-bc1f-cb099242cfa8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:51.470684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0ef1b-b550-448f-9835-77cf158ba6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:51.471512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0ef1b-b550-448f-9835-77cf158ba6ab admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.471794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0ef1b-b550-448f-9835-77cf158ba6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.472065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0ef1b-b550-448f-9835-77cf158ba6ab admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.472764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0ef1b-b550-448f-9835-77cf158ba6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:51.474758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0ef1b-b550-448f-9835-77cf158ba6ab admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:51.579844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1061/2120] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:51 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:48:51.584346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d3a2-1ea6-4fc7-91cf-43736d6b4f7f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:51.594968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454d3a2-1ea6-4fc7-91cf-43736d6b4f7f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:51.599694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8dd8-3ced-450b-ab67-53194c2ad615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:51.600359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8dd8-3ced-450b-ab67-53194c2ad615 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.600640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8dd8-3ced-450b-ab67-53194c2ad615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.600914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f8dd8-3ced-450b-ab67-53194c2ad615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.601683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f8dd8-3ced-450b-ab67-53194c2ad615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:51.604167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f8dd8-3ced-450b-ab67-53194c2ad615 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:51.616159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1060/2121] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:51.621053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0ef1b-b550-448f-9835-77cf158ba6ab admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:51.631425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0ef1b-b550-448f-9835-77cf158ba6ab admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:51.636250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b1a9e-06f3-4304-8131-fcf5522df21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:51.637303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b1a9e-06f3-4304-8131-fcf5522df21e admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.637667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b1a9e-06f3-4304-8131-fcf5522df21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.638094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b1a9e-06f3-4304-8131-fcf5522df21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.638961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b1a9e-06f3-4304-8131-fcf5522df21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:51.640560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b1a9e-06f3-4304-8131-fcf5522df21e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:51.652069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1062/2122] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:51.656463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8dd8-3ced-450b-ab67-53194c2ad615 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:51.667715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f8dd8-3ced-450b-ab67-53194c2ad615 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:51.672416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e7abe-c272-485f-8b98-e0f244a54014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:51.673304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7abe-c272-485f-8b98-e0f244a54014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.673578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7abe-c272-485f-8b98-e0f244a54014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.673847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7abe-c272-485f-8b98-e0f244a54014 admin admin] PATH_INFO: `/v3/projects/9b456d49b09b4c98830844327b0d24c9/users/0b799243f57a499d90c522c47251b338/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.685234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:51.698130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e7abe-c272-485f-8b98-e0f244a54014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b456d49b09b4c98830844327b0d24c9, user_id=0b799243f57a499d90c522c47251b338, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:51.700837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e7abe-c272-485f-8b98-e0f244a54014 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:51.764672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1061/2123] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:51 2022] PUT /identity/v3/projects/9b456d49b09b4c98830844327b0d24c9/users/0b799243f57a499d90c522c47251b338/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:48:51.776214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b1c6-f8d4-494c-b626-baaf1192332e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.776500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b1c6-f8d4-494c-b626-baaf1192332e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.776774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664b1c6-f8d4-494c-b626-baaf1192332e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.806848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7664b1c6-f8d4-494c-b626-baaf1192332e None None] MFA Rules not processed for user `0b799243f57a499d90c522c47251b338`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:51.808084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7664b1c6-f8d4-494c-b626-baaf1192332e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:51.879314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1063/2124] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:48:51.884108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e7abe-c272-485f-8b98-e0f244a54014 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:51.917665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:51.957843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e7abe-c272-485f-8b98-e0f244a54014 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:51.963448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578cdf6-9579-4808-ba41-198cc04e789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:51.964123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cdf6-9579-4808-ba41-198cc04e789f admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:51.964408 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cdf6-9579-4808-ba41-198cc04e789f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:51.964685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cdf6-9579-4808-ba41-198cc04e789f admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:51.965448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578cdf6-9579-4808-ba41-198cc04e789f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:51.967470 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578cdf6-9579-4808-ba41-198cc04e789f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:52.044393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1062/2125] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:51 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:52.048689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b1c6-f8d4-494c-b626-baaf1192332e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:52.061375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664b1c6-f8d4-494c-b626-baaf1192332e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:52.128072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4168dba-3d9d-412a-b03c-43334c78a43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:52.128893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168dba-3d9d-412a-b03c-43334c78a43d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.129011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168dba-3d9d-412a-b03c-43334c78a43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.129275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168dba-3d9d-412a-b03c-43334c78a43d admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.129968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4168dba-3d9d-412a-b03c-43334c78a43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:52.131915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4168dba-3d9d-412a-b03c-43334c78a43d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:52.157216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.220453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1064/2126] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:52 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:52.224720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578cdf6-9579-4808-ba41-198cc04e789f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:52.237825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578cdf6-9579-4808-ba41-198cc04e789f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:52.242656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85078-4634-4c90-b95e-0c831d1b3c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:52.243470 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85078-4634-4c90-b95e-0c831d1b3c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.243744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85078-4634-4c90-b95e-0c831d1b3c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.244019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d85078-4634-4c90-b95e-0c831d1b3c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.244738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d85078-4634-4c90-b95e-0c831d1b3c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:52.246425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d85078-4634-4c90-b95e-0c831d1b3c98 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:52.257756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1063/2127] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:52.262438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4168dba-3d9d-412a-b03c-43334c78a43d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:52.272814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4168dba-3d9d-412a-b03c-43334c78a43d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:52.278816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3afd3c-a7b3-4f04-a1e3-06b2bfb499ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:52.279495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3afd3c-a7b3-4f04-a1e3-06b2bfb499ef admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.279781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3afd3c-a7b3-4f04-a1e3-06b2bfb499ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.280062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3afd3c-a7b3-4f04-a1e3-06b2bfb499ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.280794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3afd3c-a7b3-4f04-a1e3-06b2bfb499ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:52.282390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3afd3c-a7b3-4f04-a1e3-06b2bfb499ef admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:52.293798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1065/2128] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:52.297854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85078-4634-4c90-b95e-0c831d1b3c98 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:52.308070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d85078-4634-4c90-b95e-0c831d1b3c98 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:52.312849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3f99f-b8df-4091-9340-6218ef5d5968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:52.313733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3f99f-b8df-4091-9340-6218ef5d5968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.314046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3f99f-b8df-4091-9340-6218ef5d5968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.314327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf3f99f-b8df-4091-9340-6218ef5d5968 admin admin] PATH_INFO: `/v3/projects/b243fb67dd0d404995f007d8f8edcc34/users/247abdcb0559441e97b9741b0ffd7c1a/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.330198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3f99f-b8df-4091-9340-6218ef5d5968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b243fb67dd0d404995f007d8f8edcc34, user_id=247abdcb0559441e97b9741b0ffd7c1a, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:52.332918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf3f99f-b8df-4091-9340-6218ef5d5968 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:52.415097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1064/2129] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:52 2022] PUT /identity/v3/projects/b243fb67dd0d404995f007d8f8edcc34/users/247abdcb0559441e97b9741b0ffd7c1a/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:52.420196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.425166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c9a5-f631-4c51-a7b9-eeecc3bffc67 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.425452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c9a5-f631-4c51-a7b9-eeecc3bffc67 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.425841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c9a5-f631-4c51-a7b9-eeecc3bffc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.455191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-27d9c9a5-f631-4c51-a7b9-eeecc3bffc67 None None] MFA Rules not processed for user `247abdcb0559441e97b9741b0ffd7c1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:52.456412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-27d9c9a5-f631-4c51-a7b9-eeecc3bffc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:52.520676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.529245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1066/2130] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:52.533956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3f99f-b8df-4091-9340-6218ef5d5968 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:52.601047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf3f99f-b8df-4091-9340-6218ef5d5968 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:52.605901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327807f8-d30c-40ea-a3ff-cc97cb9ca70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:52.606591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327807f8-d30c-40ea-a3ff-cc97cb9ca70a admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.606920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327807f8-d30c-40ea-a3ff-cc97cb9ca70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.607191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327807f8-d30c-40ea-a3ff-cc97cb9ca70a admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.607882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327807f8-d30c-40ea-a3ff-cc97cb9ca70a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:52.609772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327807f8-d30c-40ea-a3ff-cc97cb9ca70a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:52.615188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.702229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1065/2131] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:48:52 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:52.706289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9c9a5-f631-4c51-a7b9-eeecc3bffc67 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:52.718181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9c9a5-f631-4c51-a7b9-eeecc3bffc67 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:52.755963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.777928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48027-1134-4e20-9192-80fef57464a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:52.778738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48027-1134-4e20-9192-80fef57464a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.779227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48027-1134-4e20-9192-80fef57464a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.779799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a48027-1134-4e20-9192-80fef57464a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.781065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48027-1134-4e20-9192-80fef57464a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:52.783157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a48027-1134-4e20-9192-80fef57464a8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:52.866347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1067/2132] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:48:52 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:48:52.870474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327807f8-d30c-40ea-a3ff-cc97cb9ca70a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:52.880914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327807f8-d30c-40ea-a3ff-cc97cb9ca70a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:52.890145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756f3ec-abdb-4687-a26a-9e2fb741655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:52.890145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756f3ec-abdb-4687-a26a-9e2fb741655a admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.890145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756f3ec-abdb-4687-a26a-9e2fb741655a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.890145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756f3ec-abdb-4687-a26a-9e2fb741655a admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.890592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756f3ec-abdb-4687-a26a-9e2fb741655a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:52.890592 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756f3ec-abdb-4687-a26a-9e2fb741655a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:52.902516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1066/2133] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:52.906700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48027-1134-4e20-9192-80fef57464a8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:52.918463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a48027-1134-4e20-9192-80fef57464a8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:52.923464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9f4ba-c969-48ae-b66d-a6f0de00e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:52.924394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9f4ba-c969-48ae-b66d-a6f0de00e9e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:52.924724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9f4ba-c969-48ae-b66d-a6f0de00e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:52.924998 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9f4ba-c969-48ae-b66d-a6f0de00e9e5 admin admin] PATH_INFO: `/v3/projects/a078375de36747cda0a8b814cc16f347/users/a1a25f4816394719b314f96d8331d76c/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:52.929462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:52.941103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9f4ba-c969-48ae-b66d-a6f0de00e9e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a078375de36747cda0a8b814cc16f347, user_id=a1a25f4816394719b314f96d8331d76c, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:52.943789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9f4ba-c969-48ae-b66d-a6f0de00e9e5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:53.009973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1068/2134] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:52 2022] PUT /identity/v3/projects/a078375de36747cda0a8b814cc16f347/users/a1a25f4816394719b314f96d8331d76c/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:53.014264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756f3ec-abdb-4687-a26a-9e2fb741655a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:53.015874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:53.027796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756f3ec-abdb-4687-a26a-9e2fb741655a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:53.114875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae7a2a-6840-42cf-8ba1-a6f7caaae30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:53.116016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae7a2a-6840-42cf-8ba1-a6f7caaae30f admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:53.116501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae7a2a-6840-42cf-8ba1-a6f7caaae30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:53.116997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae7a2a-6840-42cf-8ba1-a6f7caaae30f admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:53.118638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae7a2a-6840-42cf-8ba1-a6f7caaae30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:53.121606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ae7a2a-6840-42cf-8ba1-a6f7caaae30f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:53.135870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1067/2135] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:48:53 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:48:53.140164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9f4ba-c969-48ae-b66d-a6f0de00e9e5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:53.162419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9f4ba-c969-48ae-b66d-a6f0de00e9e5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:53.168403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:53.169756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:53.169756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:53.170005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] PATH_INFO: `/v3/projects/a078375de36747cda0a8b814cc16f347/users/a1a25f4816394719b314f96d8331d76c/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:53.172259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a078375de36747cda0a8b814cc16f347, user_id=a1a25f4816394719b314f96d8331d76c, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:53.176079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:53.189924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1069/2136] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:48:53 2022] PUT /identity/v3/projects/a078375de36747cda0a8b814cc16f347/users/a1a25f4816394719b314f96d8331d76c/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:48:53.204976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1c70-4ca3-4da5-a0b9-c0007acc394a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:53.205362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1c70-4ca3-4da5-a0b9-c0007acc394a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:53.205720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0b1c70-4ca3-4da5-a0b9-c0007acc394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:53.235817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ac0b1c70-4ca3-4da5-a0b9-c0007acc394a None None] MFA Rules not processed for user `a1a25f4816394719b314f96d8331d76c`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:48:53.237173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ac0b1c70-4ca3-4da5-a0b9-c0007acc394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:53.316274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1068/2137] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:48:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:48:53.323978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:53.328457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:53.330240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:53.363648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:53.391126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c32ea-b3f2-410b-aeef-d81cc00aaa52 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:53.394844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:53.395500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:53.395785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:53.396074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:53.456234 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:53.457675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:53.467135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1070/2138] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:54.032092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:54.328722 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:54.637887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:54.751919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:55.094612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:55.807717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1c70-4ca3-4da5-a0b9-c0007acc394a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:55.818050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0b1c70-4ca3-4da5-a0b9-c0007acc394a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:55.822339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:55.823016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:55.823298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:55.823572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:55.825417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:55.887528 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:55.888949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:55.898641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1069/2139] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:56.009736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:56.416478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:56.417888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:56.429122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f312b-406c-4cf9-8abd-9961f71154a8 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:56.433424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:56.434160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:56.434437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:56.434789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:56.436887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:56.501194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:56.502659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:56.512866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1071/2140] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:48:56.883709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:57.026908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:57.243844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:57.252438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a556d-4373-4ffa-b4f4-3a0791483131 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:57.256149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773042-553a-4ff0-b371-f611ccbc8909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:57.256862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773042-553a-4ff0-b371-f611ccbc8909 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:57.257144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773042-553a-4ff0-b371-f611ccbc8909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:57.257416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad773042-553a-4ff0-b371-f611ccbc8909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:57.318095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad773042-553a-4ff0-b371-f611ccbc8909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:57.319546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad773042-553a-4ff0-b371-f611ccbc8909 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:57.328448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1070/2141] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:57.510902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:58.289562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:58.683508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:59.009362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:59.397884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:59.449937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:59.533877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:48:59.544077 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5043a1-a826-48e8-814f-dc4a7d148c1b service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:48:59.548619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:48:59.549281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:48:59.549562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:48:59.549836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:48:59.551669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:48:59.619503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:48:59.621256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:48:59.631315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1072/2142] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:48:59.670730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:48:59.859086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:00.054507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:00.083247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:00.226179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:00.272285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:00.780694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:00.814598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:00.944570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:00.974660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:01.066308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:01.173302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:01.346395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:01.379022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:01.705739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:01.797960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:02.128922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:02.254815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:02.340581 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:02.578555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773042-553a-4ff0-b371-f611ccbc8909 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:02.587780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad773042-553a-4ff0-b371-f611ccbc8909 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:02.591598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:02.592243 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:02.592525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:02.592799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:02.602126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:02.604174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:02.613699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1071/2143] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:02 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:02.723492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:02.964404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:03.598388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:03.677993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:04.013587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:04.076544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:04.523733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:05.027148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:05.415988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:06.455404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:06.575411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:06.986349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:07.047362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:07.169113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:07.478371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:07.552590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:07.964273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:08.152457 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:08.552418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:08.620968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:08.889530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:09.032843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:09.090022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:09.164014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:15.146188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:15.222637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b082a48-f321-4a53-87b8-6a7f739221d7 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:15.229229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:15.230212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:15.230593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:15.230976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] PATH_INFO: `/v3/users/0b799243f57a499d90c522c47251b338` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:15.232308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b799243f57a499d90c522c47251b338)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:15.234302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:15.279841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:15.281344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:15.296255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2db8e-d499-4ea8-b7a7-357752241786 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:15.300849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:15.301731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:15.302011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:15.302280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] PATH_INFO: `/v3/users/3ecf769f9e614691bda11876dc5fae71` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:15.303517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecf769f9e614691bda11876dc5fae71)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:15.305702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:15.312616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:15.485740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b799243f57a499d90c522c47251b338'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.486411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b799243f57a499d90c522c47251b338'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.487102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b799243f57a499d90c522c47251b338'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.505140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b799243f57a499d90c522c47251b338'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.515825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2674a193-febc-40d0-902b-2182ddcd02a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b799243f57a499d90c522c47251b338'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.517564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecf769f9e614691bda11876dc5fae71'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.530723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecf769f9e614691bda11876dc5fae71'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.541334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecf769f9e614691bda11876dc5fae71'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.556881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecf769f9e614691bda11876dc5fae71'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.557758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-68cf0220-30b9-4216-941d-2147c6a44288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecf769f9e614691bda11876dc5fae71'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:15.605646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1073/2144] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:15 2022] DELETE /identity/v3/users/0b799243f57a499d90c522c47251b338 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:15.610878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfda27-d0fa-4e55-9b17-3ea4bc6c13e1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:15.611165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfda27-d0fa-4e55-9b17-3ea4bc6c13e1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:15.611444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfda27-d0fa-4e55-9b17-3ea4bc6c13e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:15.631659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-18cfda27-d0fa-4e55-9b17-3ea4bc6c13e1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:15.632870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-18cfda27-d0fa-4e55-9b17-3ea4bc6c13e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:15.728089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1072/2145] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:15 2022] DELETE /identity/v3/users/3ecf769f9e614691bda11876dc5fae71 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:15.734423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1074/2146] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:15.734665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be94f9-bc6c-4e47-8d5f-191c53a34771 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:15.734665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be94f9-bc6c-4e47-8d5f-191c53a34771 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:15.734665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be94f9-bc6c-4e47-8d5f-191c53a34771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:15.742923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfda27-d0fa-4e55-9b17-3ea4bc6c13e1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:15.746126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-18cfda27-d0fa-4e55-9b17-3ea4bc6c13e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:15.755877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e6be94f9-bc6c-4e47-8d5f-191c53a34771 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:15.757021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e6be94f9-bc6c-4e47-8d5f-191c53a34771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:15.779886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:15.820194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfda27-d0fa-4e55-9b17-3ea4bc6c13e1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:15.844367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1073/2147] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:15.860751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be94f9-bc6c-4e47-8d5f-191c53a34771 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:15.862187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e6be94f9-bc6c-4e47-8d5f-191c53a34771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:15.888785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:15.889607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:15.889893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:15.890172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:15.901455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:15.903253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:15.921591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1075/2148] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:49:15.937388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be94f9-bc6c-4e47-8d5f-191c53a34771 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:15.942455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:15.943265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:15.943607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:15.944221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:15.954648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:15.956099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:15.967280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1074/2149] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:16.463452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:16.465236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:16.480584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936a709-0b75-425f-948c-d72b13a72415 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:16.485462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:16.492557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:16.492557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:16.492557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] PATH_INFO: `/v3/projects/9b456d49b09b4c98830844327b0d24c9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:16.492557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b456d49b09b4c98830844327b0d24c9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:16.492557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:16.544002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:16.545927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:16.563548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf572f-6b40-4e50-b0c4-7c1438146228 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:16.570807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:16.570807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:16.570807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:16.571118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] PATH_INFO: `/v3/projects/42a19c7003dc4a89935350cf87741dda` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:16.572313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a19c7003dc4a89935350cf87741dda)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:16.574349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:16.601325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:16.669326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b456d49b09b4c98830844327b0d24c9', 'request_id': 'req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.669326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b456d49b09b4c98830844327b0d24c9', 'request_id': 'req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.675488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b456d49b09b4c98830844327b0d24c9', 'request_id': 'req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.737774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a19c7003dc4a89935350cf87741dda', 'request_id': 'req-36b59457-e9d7-4201-a90a-13f0235ce2e5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.744830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a19c7003dc4a89935350cf87741dda', 'request_id': 'req-36b59457-e9d7-4201-a90a-13f0235ce2e5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.748457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] The token cache is being invalidate because project 9b456d49b09b4c98830844327b0d24c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:16.748836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.750932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.752565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1076/2150] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:16 2022] DELETE /identity/v3/projects/9b456d49b09b4c98830844327b0d24c9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:16.757762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:16.759202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:16.828458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b0aae-4c61-4c8e-adac-02454a4fbaa5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:16.832509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:16.838484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a19c7003dc4a89935350cf87741dda', 'request_id': 'req-36b59457-e9d7-4201-a90a-13f0235ce2e5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.851020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] The token cache is being invalidate because project 42a19c7003dc4a89935350cf87741dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:16.851454 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.852176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:16.856382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1075/2151] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:16 2022] DELETE /identity/v3/projects/42a19c7003dc4a89935350cf87741dda => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:16.860766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:16.862690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:16.935428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:16.936965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:16.937490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:16.937871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] PATH_INFO: `/v3/users/247abdcb0559441e97b9741b0ffd7c1a` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:16.939372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=247abdcb0559441e97b9741b0ffd7c1a)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:16.950050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:16.955092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b59457-e9d7-4201-a90a-13f0235ce2e5 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:16.961659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:16.963132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:16.963598 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:16.964166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] PATH_INFO: `/v3/users/d65bdb7c3cd04af5bca8c647f1c53996` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:16.965996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=d65bdb7c3cd04af5bca8c647f1c53996)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:16.969416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:17.186656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '247abdcb0559441e97b9741b0ffd7c1a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.187400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '247abdcb0559441e97b9741b0ffd7c1a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.188043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '247abdcb0559441e97b9741b0ffd7c1a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.201367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '247abdcb0559441e97b9741b0ffd7c1a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.208635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '247abdcb0559441e97b9741b0ffd7c1a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.229511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd65bdb7c3cd04af5bca8c647f1c53996'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.230190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd65bdb7c3cd04af5bca8c647f1c53996'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.237176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd65bdb7c3cd04af5bca8c647f1c53996'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.250647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd65bdb7c3cd04af5bca8c647f1c53996'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.259594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd65bdb7c3cd04af5bca8c647f1c53996'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:17.323392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1077/2152] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:16 2022] DELETE /identity/v3/users/247abdcb0559441e97b9741b0ffd7c1a => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:17.431214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1076/2153] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:16 2022] DELETE /identity/v3/users/d65bdb7c3cd04af5bca8c647f1c53996 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:17.874554 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:17.876029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:17.954881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:17.962066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:17.963001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8709ba-4db0-41ad-a0c6-9c85d1910339 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:18.000906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:18.018286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:18.036737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996d788-ebc2-4a3f-b410-898b5938c7ed admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:18.046398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:18.047601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:18.048085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:18.048451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] PATH_INFO: `/v3/projects/b20a437adcb44605bd37bec1b5159871` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:18.049870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20a437adcb44605bd37bec1b5159871)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:18.053761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:18.056972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:18.057943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:18.058244 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:18.058518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] PATH_INFO: `/v3/projects/b243fb67dd0d404995f007d8f8edcc34` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:18.059879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b243fb67dd0d404995f007d8f8edcc34)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:18.061932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:18.188451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20a437adcb44605bd37bec1b5159871', 'request_id': 'req-e10f8085-ff6f-4b66-aac2-63436a225141'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.188907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b243fb67dd0d404995f007d8f8edcc34', 'request_id': 'req-c9f70376-3874-4f03-b439-1e52c2568054'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.194113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20a437adcb44605bd37bec1b5159871', 'request_id': 'req-e10f8085-ff6f-4b66-aac2-63436a225141'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.195113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b243fb67dd0d404995f007d8f8edcc34', 'request_id': 'req-c9f70376-3874-4f03-b439-1e52c2568054'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.202086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b243fb67dd0d404995f007d8f8edcc34', 'request_id': 'req-c9f70376-3874-4f03-b439-1e52c2568054'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.346629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20a437adcb44605bd37bec1b5159871', 'request_id': 'req-e10f8085-ff6f-4b66-aac2-63436a225141'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.359698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] The token cache is being invalidate because project b20a437adcb44605bd37bec1b5159871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:18.360056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.360702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.362364 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1077/2154] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:17 2022] DELETE /identity/v3/projects/b20a437adcb44605bd37bec1b5159871 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:18.366084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:18.367561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:18.439964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f8085-ff6f-4b66-aac2-63436a225141 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:18.500908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:18.501942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:18.502217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:18.502487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] PATH_INFO: `/v3/users/4480c38b17dd4dd1b227e053ee385937` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:18.503815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4480c38b17dd4dd1b227e053ee385937)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:18.505807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:18.552193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] The token cache is being invalidate because project b243fb67dd0d404995f007d8f8edcc34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:18.552407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.553042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.554625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1078/2155] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:17 2022] DELETE /identity/v3/projects/b243fb67dd0d404995f007d8f8edcc34 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:18.559505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:18.560856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:18.574002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f70376-3874-4f03-b439-1e52c2568054 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:18.578598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:18.579487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:18.579767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:18.580049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] PATH_INFO: `/v3/users/a1a25f4816394719b314f96d8331d76c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:18.581378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a25f4816394719b314f96d8331d76c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:18.583339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:18.632754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:18.719304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4480c38b17dd4dd1b227e053ee385937'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.719957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4480c38b17dd4dd1b227e053ee385937'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.726950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4480c38b17dd4dd1b227e053ee385937'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.739270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4480c38b17dd4dd1b227e053ee385937'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.740035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4480c38b17dd4dd1b227e053ee385937'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.783845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a25f4816394719b314f96d8331d76c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.784486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a25f4816394719b314f96d8331d76c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.785212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a25f4816394719b314f96d8331d76c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.798505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a25f4816394719b314f96d8331d76c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.806635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a25f4816394719b314f96d8331d76c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:18.825214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1078/2156] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:18 2022] DELETE /identity/v3/users/4480c38b17dd4dd1b227e053ee385937 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:18.890473 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1079/2157] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:18 2022] DELETE /identity/v3/users/a1a25f4816394719b314f96d8331d76c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:19.367543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:19.369647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:19.370273 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:19.372127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:19.429012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:19.449104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a7435-4bee-44da-95e2-23e0b7ad9c7a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:19.464666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200d788-68cb-4b38-8972-bc0c538e9b80 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:19.470285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:19.471316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.471660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.471998 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] PATH_INFO: `/v3/projects/a078375de36747cda0a8b814cc16f347` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.473720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a078375de36747cda0a8b814cc16f347)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:19.475720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:19.516599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:19.517483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.517764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.518039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] PATH_INFO: `/v3/projects/1c3e221a66ba44438660caa3c5379564` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.519240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3e221a66ba44438660caa3c5379564)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:19.521162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:19.586749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a078375de36747cda0a8b814cc16f347', 'request_id': 'req-9324843d-8ad5-41cd-97e6-12fe8927adbf'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.593761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a078375de36747cda0a8b814cc16f347', 'request_id': 'req-9324843d-8ad5-41cd-97e6-12fe8927adbf'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.599517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a078375de36747cda0a8b814cc16f347', 'request_id': 'req-9324843d-8ad5-41cd-97e6-12fe8927adbf'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.624173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:19.631306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3e221a66ba44438660caa3c5379564', 'request_id': 'req-3f71a695-1bd3-4deb-a5b6-f8548948bee2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.636970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3e221a66ba44438660caa3c5379564', 'request_id': 'req-3f71a695-1bd3-4deb-a5b6-f8548948bee2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.693850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] The token cache is being invalidate because project a078375de36747cda0a8b814cc16f347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:19.694133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.694809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9324843d-8ad5-41cd-97e6-12fe8927adbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.696403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1080/2158] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:19 2022] DELETE /identity/v3/projects/a078375de36747cda0a8b814cc16f347 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:19.701238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24289e-2b70-478f-bcec-625ec84d6f39 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.701528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24289e-2b70-478f-bcec-625ec84d6f39 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.701801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc24289e-2b70-478f-bcec-625ec84d6f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.741576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cc24289e-2b70-478f-bcec-625ec84d6f39 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:19.742957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cc24289e-2b70-478f-bcec-625ec84d6f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:19.758202 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3e221a66ba44438660caa3c5379564', 'request_id': 'req-3f71a695-1bd3-4deb-a5b6-f8548948bee2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.769983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] The token cache is being invalidate because project 1c3e221a66ba44438660caa3c5379564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:19.770265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.770920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-3f71a695-1bd3-4deb-a5b6-f8548948bee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:19.777734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1079/2159] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:19 2022] DELETE /identity/v3/projects/1c3e221a66ba44438660caa3c5379564 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:19.779135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e449b-1d5e-4b03-bf96-4c5978634d88 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.779417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e449b-1d5e-4b03-bf96-4c5978634d88 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.779692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e449b-1d5e-4b03-bf96-4c5978634d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.798294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-218e449b-1d5e-4b03-bf96-4c5978634d88 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:19.799551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-218e449b-1d5e-4b03-bf96-4c5978634d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:19.807783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1081/2160] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:19.808055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1080/2161] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:19.815252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243beafe-466f-4360-9aec-d4ff858bba4b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.815544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243beafe-466f-4360-9aec-d4ff858bba4b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.815645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6721f6-ff87-4426-92fd-60aff0cafcba None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.815873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243beafe-466f-4360-9aec-d4ff858bba4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.815972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6721f6-ff87-4426-92fd-60aff0cafcba None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.816207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6721f6-ff87-4426-92fd-60aff0cafcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.834708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-243beafe-466f-4360-9aec-d4ff858bba4b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:19.834941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9a6721f6-ff87-4426-92fd-60aff0cafcba None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:19.836447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9a6721f6-ff87-4426-92fd-60aff0cafcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:19.836565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-243beafe-466f-4360-9aec-d4ff858bba4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:19.845544 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1081/2162] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:19.849739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6721f6-ff87-4426-92fd-60aff0cafcba None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:19.852477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1082/2163] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:19.857449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243beafe-466f-4360-9aec-d4ff858bba4b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:19.864933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6721f6-ff87-4426-92fd-60aff0cafcba None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:19.867064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243beafe-466f-4360-9aec-d4ff858bba4b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:19.871936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:19.872392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:19.872603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.872888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.873226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.873377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.873672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.873952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.874059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:19.874300 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:19.874711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:19.875021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:19.876005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:19.876814 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:19.891456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1082/2164] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:49:19.896099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1083/2165] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:49:19.897769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:19.900918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:19.909631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a53bb12-d2d1-439b-971d-00e4c17f350c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:19.911142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5fd30-9f12-4b9c-b6af-36d3021de147 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:19.914761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf04156-fa81-4f1f-8805-e1daea151a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:19.916761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04156-fa81-4f1f-8805-e1daea151a4e admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.916761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04156-fa81-4f1f-8805-e1daea151a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.917011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746cdf7-1be9-48b1-83d0-59347bf3eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:19.917139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf04156-fa81-4f1f-8805-e1daea151a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.917435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746cdf7-1be9-48b1-83d0-59347bf3eb32 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:19.917716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746cdf7-1be9-48b1-83d0-59347bf3eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:19.917992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746cdf7-1be9-48b1-83d0-59347bf3eb32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:19.918362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf04156-fa81-4f1f-8805-e1daea151a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:19.918732 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746cdf7-1be9-48b1-83d0-59347bf3eb32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:19.920641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746cdf7-1be9-48b1-83d0-59347bf3eb32 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:19.922706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf04156-fa81-4f1f-8805-e1daea151a4e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.034849 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1084/2166] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:19 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:20.039404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746cdf7-1be9-48b1-83d0-59347bf3eb32 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.048794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:20.085766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1083/2167] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:19 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:20.092341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf04156-fa81-4f1f-8805-e1daea151a4e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.106108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746cdf7-1be9-48b1-83d0-59347bf3eb32 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.169621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf04156-fa81-4f1f-8805-e1daea151a4e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.174212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe1af-c2f7-45aa-814c-b4106556c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.174825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a159a82-5ee8-4ee6-ae65-117a2121eb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.174992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe1af-c2f7-45aa-814c-b4106556c678 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.175164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159a82-5ee8-4ee6-ae65-117a2121eb72 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.175277 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe1af-c2f7-45aa-814c-b4106556c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.175448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159a82-5ee8-4ee6-ae65-117a2121eb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.175547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbe1af-c2f7-45aa-814c-b4106556c678 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.175723 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a159a82-5ee8-4ee6-ae65-117a2121eb72 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.176157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbe1af-c2f7-45aa-814c-b4106556c678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.176426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a159a82-5ee8-4ee6-ae65-117a2121eb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.178190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bbe1af-c2f7-45aa-814c-b4106556c678 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.178464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a159a82-5ee8-4ee6-ae65-117a2121eb72 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.389683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1084/2168] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:20 2022] POST /identity/v3/users => generated 287 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:20.395229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a159a82-5ee8-4ee6-ae65-117a2121eb72 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.407092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a159a82-5ee8-4ee6-ae65-117a2121eb72 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.411936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1009202-b339-425a-95dd-fe6a60b92c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.412612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1009202-b339-425a-95dd-fe6a60b92c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.412895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1009202-b339-425a-95dd-fe6a60b92c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.413169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1009202-b339-425a-95dd-fe6a60b92c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.414152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1009202-b339-425a-95dd-fe6a60b92c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.416222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1009202-b339-425a-95dd-fe6a60b92c7d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.428222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1085/2169] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:20 2022] POST /identity/v3/users => generated 282 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:20.429745 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1085/2170] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:49:20.436429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1009202-b339-425a-95dd-fe6a60b92c7d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.436593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe1af-c2f7-45aa-814c-b4106556c678 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.447709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bbe1af-c2f7-45aa-814c-b4106556c678 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.453441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19e761-6f54-42c2-9e42-4dae7c00c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.454133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e761-6f54-42c2-9e42-4dae7c00c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.454414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e761-6f54-42c2-9e42-4dae7c00c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.454749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19e761-6f54-42c2-9e42-4dae7c00c9d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.455555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19e761-6f54-42c2-9e42-4dae7c00c9d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.457229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a19e761-6f54-42c2-9e42-4dae7c00c9d4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.460002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1009202-b339-425a-95dd-fe6a60b92c7d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.468593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1086/2171] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:20.472532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19e761-6f54-42c2-9e42-4dae7c00c9d4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.474050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb87c6-01a3-47c4-a301-c0b423a4bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.474799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb87c6-01a3-47c4-a301-c0b423a4bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.475084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb87c6-01a3-47c4-a301-c0b423a4bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.475362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb87c6-01a3-47c4-a301-c0b423a4bc87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.476102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb87c6-01a3-47c4-a301-c0b423a4bc87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.477979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb87c6-01a3-47c4-a301-c0b423a4bc87 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.484705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a19e761-6f54-42c2-9e42-4dae7c00c9d4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.491518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1086/2172] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:20.494568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6798b05-084f-497a-a4aa-e5df26afddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.495963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb87c6-01a3-47c4-a301-c0b423a4bc87 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.496213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798b05-084f-497a-a4aa-e5df26afddca admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.498217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798b05-084f-497a-a4aa-e5df26afddca admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.498680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6798b05-084f-497a-a4aa-e5df26afddca admin admin] PATH_INFO: `/v3/projects/715234a6c24c463a9c40fe514009b53f/users/104ec7dc57e044b9840f58dfccdf364f/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.510079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb87c6-01a3-47c4-a301-c0b423a4bc87 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.518654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348945-9189-4c66-bb55-2c78a4a9c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.521746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348945-9189-4c66-bb55-2c78a4a9c798 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.521746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348945-9189-4c66-bb55-2c78a4a9c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.521746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c348945-9189-4c66-bb55-2c78a4a9c798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.521746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348945-9189-4c66-bb55-2c78a4a9c798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.523933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c348945-9189-4c66-bb55-2c78a4a9c798 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.526572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6798b05-084f-497a-a4aa-e5df26afddca admin admin] RBAC: Authorizing `identity:create_grant(project_id=715234a6c24c463a9c40fe514009b53f, user_id=104ec7dc57e044b9840f58dfccdf364f, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.536551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6798b05-084f-497a-a4aa-e5df26afddca admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.536699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1087/2173] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:20.547661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348945-9189-4c66-bb55-2c78a4a9c798 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.558485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c348945-9189-4c66-bb55-2c78a4a9c798 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.563498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a41b10d-cefd-433b-a802-c1c1dbb01436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.564397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b10d-cefd-433b-a802-c1c1dbb01436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.564679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b10d-cefd-433b-a802-c1c1dbb01436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.564956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a41b10d-cefd-433b-a802-c1c1dbb01436 admin admin] PATH_INFO: `/v3/projects/9197f50b232b45e0b25f6a6b3df902f5/users/e3881a401b654b79b5b220d3ff65a81e/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.580799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41b10d-cefd-433b-a802-c1c1dbb01436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9197f50b232b45e0b25f6a6b3df902f5, user_id=e3881a401b654b79b5b220d3ff65a81e, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.583845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a41b10d-cefd-433b-a802-c1c1dbb01436 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.610677 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1087/2174] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:20 2022] PUT /identity/v3/projects/715234a6c24c463a9c40fe514009b53f/users/104ec7dc57e044b9840f58dfccdf364f/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:20.621506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9bd6-48ef-4f90-aba7-904141b24900 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.621801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9bd6-48ef-4f90-aba7-904141b24900 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.622086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651c9bd6-48ef-4f90-aba7-904141b24900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.652204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-651c9bd6-48ef-4f90-aba7-904141b24900 None None] MFA Rules not processed for user `104ec7dc57e044b9840f58dfccdf364f`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:20.653457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-651c9bd6-48ef-4f90-aba7-904141b24900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:20.673900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1088/2175] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:20 2022] PUT /identity/v3/projects/9197f50b232b45e0b25f6a6b3df902f5/users/e3881a401b654b79b5b220d3ff65a81e/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:20.684033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c849a2-07fe-419f-8878-743d237ac54f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.684323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c849a2-07fe-419f-8878-743d237ac54f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.684599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c849a2-07fe-419f-8878-743d237ac54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.702911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:20.711775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e7c849a2-07fe-419f-8878-743d237ac54f None None] MFA Rules not processed for user `e3881a401b654b79b5b220d3ff65a81e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:20.713990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e7c849a2-07fe-419f-8878-743d237ac54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:20.718725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:20.724469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1088/2176] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:20.736610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c9bd6-48ef-4f90-aba7-904141b24900 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.737994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-651c9bd6-48ef-4f90-aba7-904141b24900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:20.787018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1089/2177] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:20.803504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651c9bd6-48ef-4f90-aba7-904141b24900 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.807100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c849a2-07fe-419f-8878-743d237ac54f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:20.808952 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e7c849a2-07fe-419f-8878-743d237ac54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:20.860120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.860835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.861070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.861493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.868781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c849a2-07fe-419f-8878-743d237ac54f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:20.873778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:20.874430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:20.875418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:20.875696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:20.885011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.886440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.895684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1090/2178] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:49:20.926290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:20.927757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:20.938752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1089/2179] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:49:24.909906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:24.911729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:24.988281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34182c72-92a9-450c-b3e4-a32f56f5f3ac service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:24.993011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:24.993897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:24.994180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:24.994451 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] PATH_INFO: `/v3/users/6b148a9fa622488197fc684ccb665e1b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:24.996795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b148a9fa622488197fc684ccb665e1b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:24.998950 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:25.207509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:25.210830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b148a9fa622488197fc684ccb665e1b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.211539 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b148a9fa622488197fc684ccb665e1b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.220011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b148a9fa622488197fc684ccb665e1b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.234189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b148a9fa622488197fc684ccb665e1b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.234943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b148a9fa622488197fc684ccb665e1b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.355801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1091/2180] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:24 2022] DELETE /identity/v3/users/6b148a9fa622488197fc684ccb665e1b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:25.572108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:25.572108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:25.587764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f66ee1-a687-4eae-93b1-4b682ae2a109 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:25.659436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:25.660359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:25.660632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:25.660906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] PATH_INFO: `/v3/users/6eab7becb7bd4096b785a725b2964340` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:25.662162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eab7becb7bd4096b785a725b2964340)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:25.664544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:25.676491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:25.705653 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:25.711294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:25.758271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a69ba-7ffd-407d-8bad-f94498eb7325 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:25.769533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:25.770638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:25.770924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:25.771216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] PATH_INFO: `/v3/projects/20b96e086a2544f6863deb39403e425c` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:25.772466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b96e086a2544f6863deb39403e425c)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:25.774842 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:25.939026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b96e086a2544f6863deb39403e425c', 'request_id': 'req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.945613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b96e086a2544f6863deb39403e425c', 'request_id': 'req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.947348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eab7becb7bd4096b785a725b2964340'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.948080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eab7becb7bd4096b785a725b2964340'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.948774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eab7becb7bd4096b785a725b2964340'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.969850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eab7becb7bd4096b785a725b2964340'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:25.977463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a10985fc-87b7-4b76-abb5-965aef72d6e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eab7becb7bd4096b785a725b2964340'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:26.084559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b96e086a2544f6863deb39403e425c', 'request_id': 'req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:26.100058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] The token cache is being invalidate because project 20b96e086a2544f6863deb39403e425c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:26.100459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:26.101000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f0ed1c5d-4a8f-4e75-b535-dc9316df2486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:26.102613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1092/2181] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:25 2022] DELETE /identity/v3/projects/20b96e086a2544f6863deb39403e425c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:26.108575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59945-83a1-42ee-9f14-8ecb51dea57e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.108857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59945-83a1-42ee-9f14-8ecb51dea57e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.109130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed59945-83a1-42ee-9f14-8ecb51dea57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.128899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-0ed59945-83a1-42ee-9f14-8ecb51dea57e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:26.130147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0ed59945-83a1-42ee-9f14-8ecb51dea57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:26.160505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1090/2182] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:25 2022] DELETE /identity/v3/users/6eab7becb7bd4096b785a725b2964340 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:26.165484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7bc52-8939-4a12-a089-951d1f13f702 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.165780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7bc52-8939-4a12-a089-951d1f13f702 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.166067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e7bc52-8939-4a12-a089-951d1f13f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.186035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f8e7bc52-8939-4a12-a089-951d1f13f702 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:26.192191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f8e7bc52-8939-4a12-a089-951d1f13f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:26.212309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1093/2183] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:26.213126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97970e91-8bef-47eb-86d1-49399e7454d6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.213411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97970e91-8bef-47eb-86d1-49399e7454d6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.214279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97970e91-8bef-47eb-86d1-49399e7454d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.240280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-97970e91-8bef-47eb-86d1-49399e7454d6 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:26.241540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-97970e91-8bef-47eb-86d1-49399e7454d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:26.279424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1091/2184] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:26.290497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7bc52-8939-4a12-a089-951d1f13f702 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:26.293017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f8e7bc52-8939-4a12-a089-951d1f13f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:26.305387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:26.336043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1094/2185] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:26.340877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97970e91-8bef-47eb-86d1-49399e7454d6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:26.351202 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97970e91-8bef-47eb-86d1-49399e7454d6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:26.356205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:26.356924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.357204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.357473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.358200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:26.358504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:26.360141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:26.369491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e7bc52-8939-4a12-a089-951d1f13f702 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:26.374488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1095/2186] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:49:26.374880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75365e6-5116-485c-b4c9-ffbfb4bd9c15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:26.375551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75365e6-5116-485c-b4c9-ffbfb4bd9c15 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.375838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75365e6-5116-485c-b4c9-ffbfb4bd9c15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.376119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75365e6-5116-485c-b4c9-ffbfb4bd9c15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.379029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:26.388145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75365e6-5116-485c-b4c9-ffbfb4bd9c15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:26.395923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75365e6-5116-485c-b4c9-ffbfb4bd9c15 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:26.396066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51a2c2-b52f-4ae6-9b5b-e6f5b748f734 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:26.396066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6196d-dad3-40ad-bb68-e61822e612ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:26.396066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6196d-dad3-40ad-bb68-e61822e612ec admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.396066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6196d-dad3-40ad-bb68-e61822e612ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.396407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6196d-dad3-40ad-bb68-e61822e612ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.396855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6196d-dad3-40ad-bb68-e61822e612ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:26.398821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6196d-dad3-40ad-bb68-e61822e612ec admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:26.400007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1092/2187] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:26.548809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1096/2188] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:26 2022] POST /identity/v3/projects => generated 389 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:26.552823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75365e6-5116-485c-b4c9-ffbfb4bd9c15 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:26.563375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75365e6-5116-485c-b4c9-ffbfb4bd9c15 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:26.594172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:26.626506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c228-5f32-483a-aae0-df7f354810da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:26.627222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c228-5f32-483a-aae0-df7f354810da admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.627503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c228-5f32-483a-aae0-df7f354810da admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.627782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854c228-5f32-483a-aae0-df7f354810da admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.628472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854c228-5f32-483a-aae0-df7f354810da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:26.630442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854c228-5f32-483a-aae0-df7f354810da admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:26.784853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1093/2189] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:26 2022] POST /identity/v3/users => generated 295 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:26.789498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6196d-dad3-40ad-bb68-e61822e612ec admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:26.801613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6196d-dad3-40ad-bb68-e61822e612ec admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:26.808147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c029a-19d4-43ec-a690-b66619d548eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:26.808858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c029a-19d4-43ec-a690-b66619d548eb admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.813239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c029a-19d4-43ec-a690-b66619d548eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.813239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c029a-19d4-43ec-a690-b66619d548eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.813239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c029a-19d4-43ec-a690-b66619d548eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:26.813239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7c029a-19d4-43ec-a690-b66619d548eb admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:26.828521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1097/2190] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:26.832823 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c228-5f32-483a-aae0-df7f354810da admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:26.843741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854c228-5f32-483a-aae0-df7f354810da admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:26.848719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:26.849560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.849841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.850115 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.850888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:26.852637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:26.871190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1094/2191] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:26.879141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c029a-19d4-43ec-a690-b66619d548eb admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:26.882891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c029a-19d4-43ec-a690-b66619d548eb admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:26.888281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f1b32-7ab1-4f7d-b6e1-e48592c55c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:26.889275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1b32-7ab1-4f7d-b6e1-e48592c55c7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.889559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1b32-7ab1-4f7d-b6e1-e48592c55c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.889840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f1b32-7ab1-4f7d-b6e1-e48592c55c7e admin admin] PATH_INFO: `/v3/projects/60655349037a415e8d26e794e9d3cc79/users/34cd6fbd9b654e31a387acc25ee94d44/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.905485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:26.907491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:26.911391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f1b32-7ab1-4f7d-b6e1-e48592c55c7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60655349037a415e8d26e794e9d3cc79, user_id=34cd6fbd9b654e31a387acc25ee94d44, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:26.914677 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f1b32-7ab1-4f7d-b6e1-e48592c55c7e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:26.930160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9601ebb3-6cb7-41d7-a452-8fa5c33374db admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:26.936354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:26.937286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:26.937591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:26.937885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] PATH_INFO: `/v3/projects/5634ef7ae99a4b299e0ba317d373ffd1` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:26.939230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5634ef7ae99a4b299e0ba317d373ffd1)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:26.941246 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:27.022335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1098/2192] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:26 2022] PUT /identity/v3/projects/60655349037a415e8d26e794e9d3cc79/users/34cd6fbd9b654e31a387acc25ee94d44/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:27.027746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d919f-ded9-4edb-a5d7-831d101b5dcb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:27.028042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d919f-ded9-4edb-a5d7-831d101b5dcb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:27.028324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d919f-ded9-4edb-a5d7-831d101b5dcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:27.050323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ed8d919f-ded9-4edb-a5d7-831d101b5dcb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:27.051645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ed8d919f-ded9-4edb-a5d7-831d101b5dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:27.072294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5634ef7ae99a4b299e0ba317d373ffd1', 'request_id': 'req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.083943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5634ef7ae99a4b299e0ba317d373ffd1', 'request_id': 'req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.093310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5634ef7ae99a4b299e0ba317d373ffd1', 'request_id': 'req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.122547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1099/2193] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:27.132920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d919f-ded9-4edb-a5d7-831d101b5dcb None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:27.137700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ed8d919f-ded9-4edb-a5d7-831d101b5dcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:27.200642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d919f-ded9-4edb-a5d7-831d101b5dcb None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:27.204334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcc933-3996-43aa-abd6-dd339c35869f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:27.205005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc933-3996-43aa-abd6-dd339c35869f service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:27.205286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc933-3996-43aa-abd6-dd339c35869f service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:27.205562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc933-3996-43aa-abd6-dd339c35869f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:27.216743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcc933-3996-43aa-abd6-dd339c35869f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:27.218195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcc933-3996-43aa-abd6-dd339c35869f service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:27.229021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1100/2194] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:49:27.231613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] The token cache is being invalidate because project 5634ef7ae99a4b299e0ba317d373ffd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:27.231908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.232649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.234429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1095/2195] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:26 2022] DELETE /identity/v3/projects/5634ef7ae99a4b299e0ba317d373ffd1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:27.238549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcc933-3996-43aa-abd6-dd339c35869f service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:27.249715 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcc933-3996-43aa-abd6-dd339c35869f service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:27.254828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:27.255727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:27.256009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:27.256284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] PATH_INFO: `/v3/users/93cee88439234d329153cf3797f523f0` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:27.257577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=93cee88439234d329153cf3797f523f0)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:27.259701 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:27.278605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:27.600340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93cee88439234d329153cf3797f523f0'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.600996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93cee88439234d329153cf3797f523f0'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.608170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93cee88439234d329153cf3797f523f0'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.620264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93cee88439234d329153cf3797f523f0'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.621285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ad14b4fa-7c4d-4b62-88fc-358615cfd06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93cee88439234d329153cf3797f523f0'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:27.751851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1101/2196] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:27 2022] DELETE /identity/v3/users/93cee88439234d329153cf3797f523f0 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:28.411905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:28.416388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:28.454499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb5f14-9e7e-4644-95f6-c5a13c17ece5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:28.521290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:28.522228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:28.522510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:28.522808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] PATH_INFO: `/v3/projects/2912c85791844d97b7a38582c2f255ea` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:28.523991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2912c85791844d97b7a38582c2f255ea)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:28.525943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:28.673913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:28.685348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2912c85791844d97b7a38582c2f255ea', 'request_id': 'req-95972edc-6df4-4c92-af3a-1815f4a3bff7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:28.696673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2912c85791844d97b7a38582c2f255ea', 'request_id': 'req-95972edc-6df4-4c92-af3a-1815f4a3bff7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:28.712411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2912c85791844d97b7a38582c2f255ea', 'request_id': 'req-95972edc-6df4-4c92-af3a-1815f4a3bff7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:28.804251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] The token cache is being invalidate because project 2912c85791844d97b7a38582c2f255ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:28.806357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:28.806357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-95972edc-6df4-4c92-af3a-1815f4a3bff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:28.807325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1096/2197] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:28 2022] DELETE /identity/v3/projects/2912c85791844d97b7a38582c2f255ea => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:28.812785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed302-3bea-40ff-b3f0-5fc8499a582f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:28.813269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed302-3bea-40ff-b3f0-5fc8499a582f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:28.813269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55ed302-3bea-40ff-b3f0-5fc8499a582f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:28.844887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-d55ed302-3bea-40ff-b3f0-5fc8499a582f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:28.846158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d55ed302-3bea-40ff-b3f0-5fc8499a582f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:28.922865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1102/2198] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:28.930350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af792-a88e-4584-a330-31d6e6c0b278 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:28.930442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af792-a88e-4584-a330-31d6e6c0b278 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:28.938696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30af792-a88e-4584-a330-31d6e6c0b278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:28.960364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a30af792-a88e-4584-a330-31d6e6c0b278 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:28.961350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a30af792-a88e-4584-a330-31d6e6c0b278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:28.973231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1097/2199] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:28.977386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ed302-3bea-40ff-b3f0-5fc8499a582f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:28.988744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55ed302-3bea-40ff-b3f0-5fc8499a582f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:28.994656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:28.996557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:28.997617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:28.997905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:28.998686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:28.998984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:29.001286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:29.016548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1103/2200] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:49:29.021064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30af792-a88e-4584-a330-31d6e6c0b278 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:29.030630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30af792-a88e-4584-a330-31d6e6c0b278 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:29.038204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b257228-32b3-4bb8-8949-7c5db0e89ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:29.038956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257228-32b3-4bb8-8949-7c5db0e89ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:29.039496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257228-32b3-4bb8-8949-7c5db0e89ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:29.039772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b257228-32b3-4bb8-8949-7c5db0e89ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:29.040741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b257228-32b3-4bb8-8949-7c5db0e89ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:29.042717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b257228-32b3-4bb8-8949-7c5db0e89ff8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:29.184431 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1098/2201] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:29 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:29.188606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:29.205137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba2ac3b-521e-4f37-9be0-578233af29b0 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:29.293309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad866ae8-34d9-46fc-9df1-ad934e6c0cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:29.294193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad866ae8-34d9-46fc-9df1-ad934e6c0cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:29.294546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad866ae8-34d9-46fc-9df1-ad934e6c0cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:29.295311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad866ae8-34d9-46fc-9df1-ad934e6c0cfb admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:29.296345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad866ae8-34d9-46fc-9df1-ad934e6c0cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:29.298339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad866ae8-34d9-46fc-9df1-ad934e6c0cfb admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:29.451177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1104/2202] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:29 2022] POST /identity/v3/users => generated 305 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:29.455254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b257228-32b3-4bb8-8949-7c5db0e89ff8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:29.468577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b257228-32b3-4bb8-8949-7c5db0e89ff8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:29.474904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08e5f2-9ef5-4f9d-a26b-026e616f9245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:29.475780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08e5f2-9ef5-4f9d-a26b-026e616f9245 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:29.476133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08e5f2-9ef5-4f9d-a26b-026e616f9245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:29.476570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08e5f2-9ef5-4f9d-a26b-026e616f9245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:29.477501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08e5f2-9ef5-4f9d-a26b-026e616f9245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:29.479936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08e5f2-9ef5-4f9d-a26b-026e616f9245 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:29.495692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1099/2203] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:29.500825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad866ae8-34d9-46fc-9df1-ad934e6c0cfb admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:29.514662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad866ae8-34d9-46fc-9df1-ad934e6c0cfb admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:29.526398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42283e-e9d2-4282-8427-e61639b90c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:29.527159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42283e-e9d2-4282-8427-e61639b90c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:29.527445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42283e-e9d2-4282-8427-e61639b90c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:29.527722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42283e-e9d2-4282-8427-e61639b90c1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:29.528459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42283e-e9d2-4282-8427-e61639b90c1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:29.532625 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42283e-e9d2-4282-8427-e61639b90c1b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:29.534630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:29.555132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1105/2204] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:29 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:29.555977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08e5f2-9ef5-4f9d-a26b-026e616f9245 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:29.584519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08e5f2-9ef5-4f9d-a26b-026e616f9245 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:29.595557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd3349-37a4-4695-84d3-2656722d7101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:29.596743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd3349-37a4-4695-84d3-2656722d7101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:29.597038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd3349-37a4-4695-84d3-2656722d7101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:29.597320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd3349-37a4-4695-84d3-2656722d7101 admin admin] PATH_INFO: `/v3/projects/5c6316ee7db54be7a0372128ade3a756/users/5cd300882d56469695135656f092ca02/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:29.615777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd3349-37a4-4695-84d3-2656722d7101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c6316ee7db54be7a0372128ade3a756, user_id=5cd300882d56469695135656f092ca02, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:29.618883 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd3349-37a4-4695-84d3-2656722d7101 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:29.766288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1100/2205] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:29 2022] PUT /identity/v3/projects/5c6316ee7db54be7a0372128ade3a756/users/5cd300882d56469695135656f092ca02/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:29.779339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6574-8e45-4794-83c9-ea9754e0e857 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:29.779787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6574-8e45-4794-83c9-ea9754e0e857 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:29.780434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e6574-8e45-4794-83c9-ea9754e0e857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:29.820958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-af8e6574-8e45-4794-83c9-ea9754e0e857 None None] MFA Rules not processed for user `5cd300882d56469695135656f092ca02`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:29.822196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-af8e6574-8e45-4794-83c9-ea9754e0e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:29.920171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd3349-37a4-4695-84d3-2656722d7101 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:29.920372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1106/2206] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:29 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:30.008372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd3349-37a4-4695-84d3-2656722d7101 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:30.014087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475847c-16c8-4b68-8fd8-67df0cf1615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:30.014893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475847c-16c8-4b68-8fd8-67df0cf1615c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:30.015084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475847c-16c8-4b68-8fd8-67df0cf1615c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:30.015409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475847c-16c8-4b68-8fd8-67df0cf1615c admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:30.016125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475847c-16c8-4b68-8fd8-67df0cf1615c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:30.018781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475847c-16c8-4b68-8fd8-67df0cf1615c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:30.163471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1101/2207] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:29 2022] POST /identity/v3/projects => generated 407 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:30.170694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e6574-8e45-4794-83c9-ea9754e0e857 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:30.194325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e6574-8e45-4794-83c9-ea9754e0e857 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:30.357514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6e18-e1b1-457d-b879-9b6e49d08cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:30.358375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6e18-e1b1-457d-b879-9b6e49d08cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:30.358778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6e18-e1b1-457d-b879-9b6e49d08cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:30.361107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6e18-e1b1-457d-b879-9b6e49d08cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:30.362239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6e18-e1b1-457d-b879-9b6e49d08cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:30.364713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6e18-e1b1-457d-b879-9b6e49d08cc7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:30.514070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1107/2208] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:30 2022] POST /identity/v3/users => generated 310 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:30.517968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475847c-16c8-4b68-8fd8-67df0cf1615c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:30.529213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475847c-16c8-4b68-8fd8-67df0cf1615c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:30.534015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dafd9-45c4-4259-89fa-38cdbcba5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:30.534756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dafd9-45c4-4259-89fa-38cdbcba5cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:30.535037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dafd9-45c4-4259-89fa-38cdbcba5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:30.535324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9dafd9-45c4-4259-89fa-38cdbcba5cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:30.536044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dafd9-45c4-4259-89fa-38cdbcba5cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:30.537634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9dafd9-45c4-4259-89fa-38cdbcba5cf0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:30.564324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1102/2209] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:49:30.565565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6e18-e1b1-457d-b879-9b6e49d08cc7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:30.576151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6e18-e1b1-457d-b879-9b6e49d08cc7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:30.580945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab97ee-8c82-4f26-9c53-33fe006e27a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:30.581894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab97ee-8c82-4f26-9c53-33fe006e27a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:30.582170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab97ee-8c82-4f26-9c53-33fe006e27a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:30.582465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cab97ee-8c82-4f26-9c53-33fe006e27a9 admin admin] PATH_INFO: `/v3/projects/a3a2db6455c348f3897b9cb8cf57d2d5/users/d2e662816ce049f48333e81cce6441f9/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:30.597854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab97ee-8c82-4f26-9c53-33fe006e27a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a2db6455c348f3897b9cb8cf57d2d5, user_id=d2e662816ce049f48333e81cce6441f9, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:30.600493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cab97ee-8c82-4f26-9c53-33fe006e27a9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:30.721486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1108/2210] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:30 2022] PUT /identity/v3/projects/a3a2db6455c348f3897b9cb8cf57d2d5/users/d2e662816ce049f48333e81cce6441f9/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:30.729071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dafd9-45c4-4259-89fa-38cdbcba5cf0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:30.763647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9dafd9-45c4-4259-89fa-38cdbcba5cf0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:30.827289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:30.866963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d0ed4-8523-419b-acf1-9b127efeace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:30.866963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0ed4-8523-419b-acf1-9b127efeace4 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:30.866963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0ed4-8523-419b-acf1-9b127efeace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:30.866963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d0ed4-8523-419b-acf1-9b127efeace4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:30.867345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d0ed4-8523-419b-acf1-9b127efeace4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:30.867345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d0ed4-8523-419b-acf1-9b127efeace4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:30.878214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1103/2211] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:30.882502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab97ee-8c82-4f26-9c53-33fe006e27a9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:30.906661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cab97ee-8c82-4f26-9c53-33fe006e27a9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:30.906661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:30.906661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:30.906661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:30.907058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] PATH_INFO: `/v3/projects/a3a2db6455c348f3897b9cb8cf57d2d5/users/d2e662816ce049f48333e81cce6441f9/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:30.907058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3a2db6455c348f3897b9cb8cf57d2d5, user_id=d2e662816ce049f48333e81cce6441f9, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:30.908410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:30.925278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1109/2212] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:30 2022] PUT /identity/v3/projects/a3a2db6455c348f3897b9cb8cf57d2d5/users/d2e662816ce049f48333e81cce6441f9/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:30.937180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f8ae-7ba8-4a71-9d23-a1a7dca52713 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:30.941098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f8ae-7ba8-4a71-9d23-a1a7dca52713 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:30.941098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f8ae-7ba8-4a71-9d23-a1a7dca52713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:30.971009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a723f8ae-7ba8-4a71-9d23-a1a7dca52713 None None] MFA Rules not processed for user `d2e662816ce049f48333e81cce6441f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:30.972795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a723f8ae-7ba8-4a71-9d23-a1a7dca52713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:31.067073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1104/2213] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:30 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:31.080812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:31.082761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:31.244511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4fb709-b4df-4215-a73b-ca928eb1a2d9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:31.244511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:31.244511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:31.244511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:31.244796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:31.252878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:31.254464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:31.273453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1110/2214] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:31 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:31.737422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f8ae-7ba8-4a71-9d23-a1a7dca52713 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:31.747815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f8ae-7ba8-4a71-9d23-a1a7dca52713 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:31.751633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2480e-0310-46f7-83b8-3ed199078522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:31.752325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2480e-0310-46f7-83b8-3ed199078522 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:31.754983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2480e-0310-46f7-83b8-3ed199078522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:31.754983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2480e-0310-46f7-83b8-3ed199078522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:31.819148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2480e-0310-46f7-83b8-3ed199078522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:31.820744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2480e-0310-46f7-83b8-3ed199078522 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:31.831619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1105/2215] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:32.100979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:34.387738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:34.387738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:34.462430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd98f926-2e65-4ded-884f-1a9547f62bd2 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:34.487312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:34.499052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:34.499461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:34.499815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] PATH_INFO: `/v3/users/12bf0a524d8e424da0f25f0fe7282c61` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:34.501279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12bf0a524d8e424da0f25f0fe7282c61)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:34.503493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:34.553193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd468b3-e11f-4452-b160-cf6b298a2928 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:34.554760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd468b3-e11f-4452-b160-cf6b298a2928 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:34.555242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd468b3-e11f-4452-b160-cf6b298a2928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:34.587747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5fd468b3-e11f-4452-b160-cf6b298a2928 None None] MFA Rules not processed for user `34cd6fbd9b654e31a387acc25ee94d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:34.589396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5fd468b3-e11f-4452-b160-cf6b298a2928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:34.640081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:34.686894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1106/2216] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:34.697932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd468b3-e11f-4452-b160-cf6b298a2928 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:34.700987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5fd468b3-e11f-4452-b160-cf6b298a2928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:34.839470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd468b3-e11f-4452-b160-cf6b298a2928 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:34.844002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12bf0a524d8e424da0f25f0fe7282c61'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:34.844984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12bf0a524d8e424da0f25f0fe7282c61'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:34.848345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cff86-ad99-4e36-b1ba-ea8821c927e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:34.849030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cff86-ad99-4e36-b1ba-ea8821c927e7 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:34.850919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cff86-ad99-4e36-b1ba-ea8821c927e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:34.851143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cff86-ad99-4e36-b1ba-ea8821c927e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:34.860042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12bf0a524d8e424da0f25f0fe7282c61'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:34.860144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c54cff86-ad99-4e36-b1ba-ea8821c927e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:34.881831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cff86-ad99-4e36-b1ba-ea8821c927e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:34.881831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cff86-ad99-4e36-b1ba-ea8821c927e7 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:34.882556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12bf0a524d8e424da0f25f0fe7282c61'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:34.885025 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12bf0a524d8e424da0f25f0fe7282c61'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:34.893419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1107/2217] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:49:35.016490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1111/2218] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:34 2022] DELETE /identity/v3/users/12bf0a524d8e424da0f25f0fe7282c61 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:35.025239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf593f-b5e9-40fe-aa63-5a718c4e0ffa None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:35.025239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf593f-b5e9-40fe-aa63-5a718c4e0ffa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:35.025239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf593f-b5e9-40fe-aa63-5a718c4e0ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:35.040468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1bcf593f-b5e9-40fe-aa63-5a718c4e0ffa None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:35.041731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1bcf593f-b5e9-40fe-aa63-5a718c4e0ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:35.112536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1108/2219] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:35.122372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:35.124001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:35.215993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:35.241616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e4ca2-c217-4492-a00a-24d5d6de9833 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:35.246654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236579b-8142-48be-9f8b-a78297c61e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:35.247463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236579b-8142-48be-9f8b-a78297c61e62 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:35.247849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236579b-8142-48be-9f8b-a78297c61e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:35.248201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236579b-8142-48be-9f8b-a78297c61e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:35.272285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236579b-8142-48be-9f8b-a78297c61e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:35.272285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236579b-8142-48be-9f8b-a78297c61e62 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:35.293248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1112/2220] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:36.023668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf593f-b5e9-40fe-aa63-5a718c4e0ffa None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:36.026083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1bcf593f-b5e9-40fe-aa63-5a718c4e0ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:36.046317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf593f-b5e9-40fe-aa63-5a718c4e0ffa None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:36.051816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:36.052693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:36.052976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:36.053254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] PATH_INFO: `/v3/projects/d7f3ba0d42744940a8876058dc29dc89` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:36.054468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7f3ba0d42744940a8876058dc29dc89)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:36.056606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:36.266011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:36.288250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7f3ba0d42744940a8876058dc29dc89', 'request_id': 'req-cce8dbc5-474c-434f-a494-74b603429147'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:36.293931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7f3ba0d42744940a8876058dc29dc89', 'request_id': 'req-cce8dbc5-474c-434f-a494-74b603429147'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:36.299964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7f3ba0d42744940a8876058dc29dc89', 'request_id': 'req-cce8dbc5-474c-434f-a494-74b603429147'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:36.439687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] The token cache is being invalidate because project d7f3ba0d42744940a8876058dc29dc89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:36.440420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:36.441509 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-cce8dbc5-474c-434f-a494-74b603429147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:36.443275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1109/2221] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:36 2022] DELETE /identity/v3/projects/d7f3ba0d42744940a8876058dc29dc89 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:36.448512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb12dc1-9ce5-42d0-83b6-66c124ecbcf3 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:36.449293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb12dc1-9ce5-42d0-83b6-66c124ecbcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:36.449293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb12dc1-9ce5-42d0-83b6-66c124ecbcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:36.472342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-efb12dc1-9ce5-42d0-83b6-66c124ecbcf3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:36.473770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-efb12dc1-9ce5-42d0-83b6-66c124ecbcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:36.558770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1113/2222] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:36.567526 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f77fbd-f108-48f6-bef2-4f53cbae0c5e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:36.567996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f77fbd-f108-48f6-bef2-4f53cbae0c5e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:36.568399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f77fbd-f108-48f6-bef2-4f53cbae0c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:36.594141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-42f77fbd-f108-48f6-bef2-4f53cbae0c5e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:36.595671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-42f77fbd-f108-48f6-bef2-4f53cbae0c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:36.604188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1110/2223] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:36.608637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb12dc1-9ce5-42d0-83b6-66c124ecbcf3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:36.618418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb12dc1-9ce5-42d0-83b6-66c124ecbcf3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:36.623391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:36.624102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:36.624385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:36.624778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:36.625501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:36.625813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:36.627527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:36.640799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1114/2224] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:49:36.645458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f77fbd-f108-48f6-bef2-4f53cbae0c5e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:36.656193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f77fbd-f108-48f6-bef2-4f53cbae0c5e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:36.661405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4733ef3-3c61-45bb-b570-848ab37b1cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:36.662186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4733ef3-3c61-45bb-b570-848ab37b1cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:36.662439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4733ef3-3c61-45bb-b570-848ab37b1cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:36.662916 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4733ef3-3c61-45bb-b570-848ab37b1cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:36.664049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4733ef3-3c61-45bb-b570-848ab37b1cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:36.666348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4733ef3-3c61-45bb-b570-848ab37b1cb2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:36.794892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1111/2225] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:36 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:36.797334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:36.818239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687c3d6-dc8e-4633-af94-1647f675b1ad admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:37.026402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a920897-6bf0-4b24-b304-f14dd43d13fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:37.027191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a920897-6bf0-4b24-b304-f14dd43d13fb admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:37.028395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a920897-6bf0-4b24-b304-f14dd43d13fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:37.028702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a920897-6bf0-4b24-b304-f14dd43d13fb admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:37.029439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a920897-6bf0-4b24-b304-f14dd43d13fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:37.031566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a920897-6bf0-4b24-b304-f14dd43d13fb admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:37.212751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1115/2226] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:36 2022] POST /identity/v3/users => generated 292 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:37.216067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4733ef3-3c61-45bb-b570-848ab37b1cb2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:37.226458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4733ef3-3c61-45bb-b570-848ab37b1cb2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:37.231770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800fd5b-1701-4500-9c40-2258476c27bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:37.232475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800fd5b-1701-4500-9c40-2258476c27bd admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:37.232756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800fd5b-1701-4500-9c40-2258476c27bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:37.233201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800fd5b-1701-4500-9c40-2258476c27bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:37.233932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800fd5b-1701-4500-9c40-2258476c27bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:37.235557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800fd5b-1701-4500-9c40-2258476c27bd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:37.247128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1112/2227] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:37.251627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a920897-6bf0-4b24-b304-f14dd43d13fb admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:37.265081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a920897-6bf0-4b24-b304-f14dd43d13fb admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:37.270920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179abb56-066c-4bf4-b423-2ba0397d5eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:37.270920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abb56-066c-4bf4-b423-2ba0397d5eef admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:37.271115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abb56-066c-4bf4-b423-2ba0397d5eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:37.280569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179abb56-066c-4bf4-b423-2ba0397d5eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:37.280569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179abb56-066c-4bf4-b423-2ba0397d5eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:37.280569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179abb56-066c-4bf4-b423-2ba0397d5eef admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:37.289220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1116/2228] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:37.294517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800fd5b-1701-4500-9c40-2258476c27bd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:37.304819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800fd5b-1701-4500-9c40-2258476c27bd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:37.311347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:37.312015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:37.312369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:37.312748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] PATH_INFO: `/v3/projects/948694fd09974ccdad5cf8a4b1d3e5b6/users/7607cee458244867a77be01fd4a5bc24/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:37.333667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=948694fd09974ccdad5cf8a4b1d3e5b6, user_id=7607cee458244867a77be01fd4a5bc24, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:37.360909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:37.606497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97073-3fcc-46af-9a4e-094a0d8159e4 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:37.607015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97073-3fcc-46af-9a4e-094a0d8159e4 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:37.607122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f97073-3fcc-46af-9a4e-094a0d8159e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:37.609023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1113/2229] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:37 2022] PUT /identity/v3/projects/948694fd09974ccdad5cf8a4b1d3e5b6/users/7607cee458244867a77be01fd4a5bc24/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:37.657776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f9f97073-3fcc-46af-9a4e-094a0d8159e4 None None] MFA Rules not processed for user `7607cee458244867a77be01fd4a5bc24`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:37.659179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f9f97073-3fcc-46af-9a4e-094a0d8159e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:37.742045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1117/2230] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:37.784698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:37.786747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:37.865987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f7d27-4cb3-4ba2-a86e-8a0410944238 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:37.872813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be76fe-d83a-4a02-9508-d01c9a8852c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:37.873583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be76fe-d83a-4a02-9508-d01c9a8852c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:37.873961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be76fe-d83a-4a02-9508-d01c9a8852c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:37.874361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be76fe-d83a-4a02-9508-d01c9a8852c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:37.894345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be76fe-d83a-4a02-9508-d01c9a8852c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:37.895853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be76fe-d83a-4a02-9508-d01c9a8852c7 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:37.931593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1114/2231] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:38.858262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bd1cc-4c23-4942-9834-d516a6e738c9 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:38.858810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bd1cc-4c23-4942-9834-d516a6e738c9 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:38.858930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bd1cc-4c23-4942-9834-d516a6e738c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:38.884915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-6a6bd1cc-4c23-4942-9834-d516a6e738c9 None None] MFA Rules not processed for user `34cd6fbd9b654e31a387acc25ee94d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:38.886742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6a6bd1cc-4c23-4942-9834-d516a6e738c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:38.974002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1118/2232] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:39.135831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:48.756038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be76fe-d83a-4a02-9508-d01c9a8852c7 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:48.834254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be76fe-d83a-4a02-9508-d01c9a8852c7 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:48.845983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:48.846487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:48.846802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:48.847083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] PATH_INFO: `/v3/users/7607cee458244867a77be01fd4a5bc24` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:48.848323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7607cee458244867a77be01fd4a5bc24)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:48.850405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:48.858215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:49.084770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7607cee458244867a77be01fd4a5bc24'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.085491 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7607cee458244867a77be01fd4a5bc24'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.086202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7607cee458244867a77be01fd4a5bc24'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.100341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7607cee458244867a77be01fd4a5bc24'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.107590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7607cee458244867a77be01fd4a5bc24'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:49.193837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1115/2233] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:48 2022] DELETE /identity/v3/users/7607cee458244867a77be01fd4a5bc24 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:49.195530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff114-d01e-4415-9643-3ae2a7ad300e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:49.197382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff114-d01e-4415-9643-3ae2a7ad300e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:49.198263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff114-d01e-4415-9643-3ae2a7ad300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:49.227003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e32ff114-d01e-4415-9643-3ae2a7ad300e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:49.228350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e32ff114-d01e-4415-9643-3ae2a7ad300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:49.296743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1119/2234] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:49.310308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:49.311985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:49.377591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13c604b-a34a-4078-83ff-bb9d85d86681 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:49.381903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63869b-6fae-4284-821d-f7b413880abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:49.382579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63869b-6fae-4284-821d-f7b413880abf service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:49.382861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63869b-6fae-4284-821d-f7b413880abf service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:49.383308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63869b-6fae-4284-821d-f7b413880abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:49.394620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63869b-6fae-4284-821d-f7b413880abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:49.396047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a63869b-6fae-4284-821d-f7b413880abf service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:49.409975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1116/2235] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:49.950318 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff114-d01e-4415-9643-3ae2a7ad300e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:49.954897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e32ff114-d01e-4415-9643-3ae2a7ad300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:49.977985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff114-d01e-4415-9643-3ae2a7ad300e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.012132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.013641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.013930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.014207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] PATH_INFO: `/v3/projects/948694fd09974ccdad5cf8a4b1d3e5b6` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.015785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=948694fd09974ccdad5cf8a4b1d3e5b6)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.018971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.186985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '948694fd09974ccdad5cf8a4b1d3e5b6', 'request_id': 'req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:50.192925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '948694fd09974ccdad5cf8a4b1d3e5b6', 'request_id': 'req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:50.344292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '948694fd09974ccdad5cf8a4b1d3e5b6', 'request_id': 'req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:50.356871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] The token cache is being invalidate because project 948694fd09974ccdad5cf8a4b1d3e5b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:50.357142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:50.357824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f3f6e950-daf1-4798-9e2e-ecfc6f46aca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:50.359455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1120/2236] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:49 2022] DELETE /identity/v3/projects/948694fd09974ccdad5cf8a4b1d3e5b6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:50.364367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80366-3661-46ca-91f0-847bb6283559 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.364822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80366-3661-46ca-91f0-847bb6283559 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.364898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce80366-3661-46ca-91f0-847bb6283559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.392637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cce80366-3661-46ca-91f0-847bb6283559 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:50.393859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cce80366-3661-46ca-91f0-847bb6283559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:50.459039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1117/2237] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:50.467868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8097a0-4168-4771-a247-f136c6d86d5c None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.468152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8097a0-4168-4771-a247-f136c6d86d5c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.468428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8097a0-4168-4771-a247-f136c6d86d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.481957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:50.488521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-6a8097a0-4168-4771-a247-f136c6d86d5c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:50.489867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6a8097a0-4168-4771-a247-f136c6d86d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:50.503237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1121/2238] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:50.503985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce80366-3661-46ca-91f0-847bb6283559 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.514694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce80366-3661-46ca-91f0-847bb6283559 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.519625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.520365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.520719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.521588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.522406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:50.522866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.533210 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.551979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1118/2239] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:49:50.557244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8097a0-4168-4771-a247-f136c6d86d5c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.569065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8097a0-4168-4771-a247-f136c6d86d5c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.574372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.575091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.575372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.575836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.577091 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.579031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.684828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1122/2240] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:50 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:50.688466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.700164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8c2be-2a33-4b56-921c-107f0a5c5b56 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.701978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.704425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:50.741621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:50.809119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.810116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.810474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.810840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.811737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.813840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.828883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c697fd8-7532-4193-910a-9e3edebcda8e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.834979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.842375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.842877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.843298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] PATH_INFO: `/v3/users/5cd300882d56469695135656f092ca02` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.844914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd300882d56469695135656f092ca02)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.847305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:50.930075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1119/2241] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:50 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:50.930075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:50.932236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:50.944165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e1a83-0594-40d5-859d-4c38772bf3f5 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:50.949332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:50.950144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:50.950421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:50.950750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] PATH_INFO: `/v3/users/104ec7dc57e044b9840f58dfccdf364f` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:50.951979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] RBAC: Authorizing `identity:delete_user(user_id=104ec7dc57e044b9840f58dfccdf364f)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:50.953924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:51.071778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd300882d56469695135656f092ca02'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.072488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd300882d56469695135656f092ca02'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.079508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd300882d56469695135656f092ca02'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.094156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd300882d56469695135656f092ca02'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.095733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd300882d56469695135656f092ca02'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.185846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1123/2242] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:50 2022] DELETE /identity/v3/users/5cd300882d56469695135656f092ca02 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:51.187129 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:51.190029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:51.193808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104ec7dc57e044b9840f58dfccdf364f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.197976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104ec7dc57e044b9840f58dfccdf364f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.198812 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104ec7dc57e044b9840f58dfccdf364f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.234501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104ec7dc57e044b9840f58dfccdf364f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.244648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104ec7dc57e044b9840f58dfccdf364f'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.308122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db998d1-699e-4fc1-84c9-604e3994390e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:51.313232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:51.314310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:51.314776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:51.315043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] PATH_INFO: `/v3/users/b294922c392540ada3883203cb41e1d2` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:51.316406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b294922c392540ada3883203cb41e1d2)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:51.318392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:51.374213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1120/2243] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:50 2022] DELETE /identity/v3/users/104ec7dc57e044b9840f58dfccdf364f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:51.375348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:51.376744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:51.449914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38b49a-3ffc-420d-a12b-6c339325e17a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:51.457106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fee276-f6df-4342-a79b-24069de03c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:51.458478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee276-f6df-4342-a79b-24069de03c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:51.459023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee276-f6df-4342-a79b-24069de03c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:51.462380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fee276-f6df-4342-a79b-24069de03c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:51.462380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fee276-f6df-4342-a79b-24069de03c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:51.462380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fee276-f6df-4342-a79b-24069de03c95 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:51.477822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1121/2244] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:51.477822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724cc2-19f6-4831-9558-98d8cffb5c8f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:51.477822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724cc2-19f6-4831-9558-98d8cffb5c8f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:51.477822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47724cc2-19f6-4831-9558-98d8cffb5c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:51.505658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-47724cc2-19f6-4831-9558-98d8cffb5c8f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:51.506976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-47724cc2-19f6-4831-9558-98d8cffb5c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:51.515799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1122/2245] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:51.517068 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d482c-ce25-43c3-b912-701e753d92c3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:51.517351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d482c-ce25-43c3-b912-701e753d92c3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:51.517621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d482c-ce25-43c3-b912-701e753d92c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:51.530079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b294922c392540ada3883203cb41e1d2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.531249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b294922c392540ada3883203cb41e1d2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.541999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b294922c392540ada3883203cb41e1d2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.559371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b294922c392540ada3883203cb41e1d2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.565441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9a3d482c-ce25-43c3-b912-701e753d92c3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:51.565900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b294922c392540ada3883203cb41e1d2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:51.565989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9a3d482c-ce25-43c3-b912-701e753d92c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:51.570589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1123/2246] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:51.571635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d482c-ce25-43c3-b912-701e753d92c3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:51.574501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9a3d482c-ce25-43c3-b912-701e753d92c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:51.590898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d482c-ce25-43c3-b912-701e753d92c3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:51.595803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:51.596503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:51.596785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:51.597056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:51.597798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:51.599467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:51.611501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1124/2247] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:51.612649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:51.613965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:51.632486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1124/2248] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:51 2022] DELETE /identity/v3/users/b294922c392540ada3883203cb41e1d2 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:51.634095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:51.636429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:51.717138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657949a-c6d2-489c-b2ad-85628dde1025 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:51.725107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b5557-7f74-44da-99d0-7acf904929e0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:51.728502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaeaab-2a82-482f-96ac-41e6d3a9f762 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:51.729320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaeaab-2a82-482f-96ac-41e6d3a9f762 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:51.729600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaeaab-2a82-482f-96ac-41e6d3a9f762 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:51.729938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaeaab-2a82-482f-96ac-41e6d3a9f762 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:51.731897 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc91721f-58ff-4392-8c1e-7a1891c2daa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:51.732663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91721f-58ff-4392-8c1e-7a1891c2daa6 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:51.733049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91721f-58ff-4392-8c1e-7a1891c2daa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:51.733426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc91721f-58ff-4392-8c1e-7a1891c2daa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:51.734600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:51.738002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fc91721f-58ff-4392-8c1e-7a1891c2daa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:51.832842 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaeaab-2a82-482f-96ac-41e6d3a9f762 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:51.834571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaeaab-2a82-482f-96ac-41e6d3a9f762 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:51.841309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91721f-58ff-4392-8c1e-7a1891c2daa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:51.842478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc91721f-58ff-4392-8c1e-7a1891c2daa6 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:51.847527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1125/2249] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:51.848696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaeaab-2a82-482f-96ac-41e6d3a9f762 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:51.862114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaeaab-2a82-482f-96ac-41e6d3a9f762 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:51.870013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:51.871651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:51.872102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:51.872555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] PATH_INFO: `/v3/projects/a4ab83dbdfb7409bbea3af2745c1ddaf/users/b760cb7932fc4b3ea0d3e7526f15be0c/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:51.874597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1125/2250] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:51.900680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4ab83dbdfb7409bbea3af2745c1ddaf, user_id=b760cb7932fc4b3ea0d3e7526f15be0c, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:51.903919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:52.029412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1126/2251] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:51 2022] PUT /identity/v3/projects/a4ab83dbdfb7409bbea3af2745c1ddaf/users/b760cb7932fc4b3ea0d3e7526f15be0c/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:52.039850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c923a-eee8-453b-8c45-cbfe05cab0f1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:52.040135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c923a-eee8-453b-8c45-cbfe05cab0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:52.040439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c923a-eee8-453b-8c45-cbfe05cab0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:52.100927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a74c923a-eee8-453b-8c45-cbfe05cab0f1 None None] MFA Rules not processed for user `b760cb7932fc4b3ea0d3e7526f15be0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:52.103185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a74c923a-eee8-453b-8c45-cbfe05cab0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:52.173722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:52.179424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:52.219678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1126/2252] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:52.300816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bfe26a-2603-44ed-8565-ba18dd1f767c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:52.319959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:52.319959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:52.319959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:52.320430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] PATH_INFO: `/v3/projects/c54f76e126c44c31a47681124cc50b3a` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:52.323370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54f76e126c44c31a47681124cc50b3a)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:52.325977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:52.438104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c923a-eee8-453b-8c45-cbfe05cab0f1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:52.439566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a74c923a-eee8-453b-8c45-cbfe05cab0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:52.521238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54f76e126c44c31a47681124cc50b3a', 'request_id': 'req-742d5959-7e5a-46ae-a390-b2e92ba27324'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.529830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54f76e126c44c31a47681124cc50b3a', 'request_id': 'req-742d5959-7e5a-46ae-a390-b2e92ba27324'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.540689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c923a-eee8-453b-8c45-cbfe05cab0f1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:52.623925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:52.627377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:52.627377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:52.627377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:52.648302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54f76e126c44c31a47681124cc50b3a', 'request_id': 'req-742d5959-7e5a-46ae-a390-b2e92ba27324'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.668242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] The token cache is being invalidate because project c54f76e126c44c31a47681124cc50b3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:52.668749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.669687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.672571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1127/2253] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:52 2022] DELETE /identity/v3/projects/c54f76e126c44c31a47681124cc50b3a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:52.673694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:52.675668 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:52.713579 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:52.715027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:52.724332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1127/2254] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:52.729447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:52.729447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:52.766356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d5959-7e5a-46ae-a390-b2e92ba27324 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:52.771384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:52.772254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:52.772799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:52.773083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] PATH_INFO: `/v3/projects/715234a6c24c463a9c40fe514009b53f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:52.774473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=715234a6c24c463a9c40fe514009b53f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:52.776468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:52.798661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af77b1-7652-4814-95f5-b10c53fbd3ed service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:52.804070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:52.805822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:52.806164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:52.806555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] PATH_INFO: `/v3/projects/5c6316ee7db54be7a0372128ade3a756` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:52.807892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c6316ee7db54be7a0372128ade3a756)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:52.811103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:52.841127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:52.898993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715234a6c24c463a9c40fe514009b53f', 'request_id': 'req-a0f275d2-02a1-4857-b0ab-3b84458a83c2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.904622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715234a6c24c463a9c40fe514009b53f', 'request_id': 'req-a0f275d2-02a1-4857-b0ab-3b84458a83c2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.965123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c6316ee7db54be7a0372128ade3a756', 'request_id': 'req-70f025be-527d-4db3-9d9d-33dbb78c0732'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.971420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c6316ee7db54be7a0372128ade3a756', 'request_id': 'req-70f025be-527d-4db3-9d9d-33dbb78c0732'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:52.977426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c6316ee7db54be7a0372128ade3a756', 'request_id': 'req-70f025be-527d-4db3-9d9d-33dbb78c0732'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.052521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715234a6c24c463a9c40fe514009b53f', 'request_id': 'req-a0f275d2-02a1-4857-b0ab-3b84458a83c2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.065220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] The token cache is being invalidate because project 715234a6c24c463a9c40fe514009b53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:53.065220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.065978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.067611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1128/2255] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:52 2022] DELETE /identity/v3/projects/715234a6c24c463a9c40fe514009b53f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:53.068375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:53.069658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:53.141135 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f275d2-02a1-4857-b0ab-3b84458a83c2 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:53.184866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] The token cache is being invalidate because project 5c6316ee7db54be7a0372128ade3a756 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:53.186608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.186608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-70f025be-527d-4db3-9d9d-33dbb78c0732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.187847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1128/2256] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:52 2022] DELETE /identity/v3/projects/5c6316ee7db54be7a0372128ade3a756 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:53.189419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadaec0-bd8c-4bc6-adec-810d1f8b0d38 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.189966 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadaec0-bd8c-4bc6-adec-810d1f8b0d38 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.190780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadaec0-bd8c-4bc6-adec-810d1f8b0d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.204635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:53.205551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.205846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.206110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] PATH_INFO: `/v3/users/332f208dd55b42f5a5de9ce0029cd63a` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.207368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=332f208dd55b42f5a5de9ce0029cd63a)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:53.209322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:53.215301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-daadaec0-bd8c-4bc6-adec-810d1f8b0d38 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:53.215301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-daadaec0-bd8c-4bc6-adec-810d1f8b0d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:53.220091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1129/2257] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:53.220930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadaec0-bd8c-4bc6-adec-810d1f8b0d38 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:53.222157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-daadaec0-bd8c-4bc6-adec-810d1f8b0d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:53.234143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadaec0-bd8c-4bc6-adec-810d1f8b0d38 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:53.238928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:53.239861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.240203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.240479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] PATH_INFO: `/v3/users/d2e662816ce049f48333e81cce6441f9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.241673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2e662816ce049f48333e81cce6441f9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:53.244242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:53.431828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '332f208dd55b42f5a5de9ce0029cd63a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.432483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '332f208dd55b42f5a5de9ce0029cd63a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.439201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '332f208dd55b42f5a5de9ce0029cd63a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.450748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '332f208dd55b42f5a5de9ce0029cd63a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.451478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-007ca304-7bea-4d3f-9ef6-3dcc6218a1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '332f208dd55b42f5a5de9ce0029cd63a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.478960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2e662816ce049f48333e81cce6441f9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.480060 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2e662816ce049f48333e81cce6441f9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.480828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2e662816ce049f48333e81cce6441f9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.495461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2e662816ce049f48333e81cce6441f9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.502717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2e662816ce049f48333e81cce6441f9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:53.541545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1129/2258] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:53 2022] DELETE /identity/v3/users/332f208dd55b42f5a5de9ce0029cd63a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:53.541545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417fda7-252f-47f6-9dbc-97c26d29eb8a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.541545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417fda7-252f-47f6-9dbc-97c26d29eb8a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.541545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9417fda7-252f-47f6-9dbc-97c26d29eb8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.560811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9417fda7-252f-47f6-9dbc-97c26d29eb8a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:53.562319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9417fda7-252f-47f6-9dbc-97c26d29eb8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:53.626630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1130/2259] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:53.630350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417fda7-252f-47f6-9dbc-97c26d29eb8a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:53.641766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1130/2260] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:49:53 2022] DELETE /identity/v3/users/d2e662816ce049f48333e81cce6441f9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:53.641961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9417fda7-252f-47f6-9dbc-97c26d29eb8a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:53.704934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:53.705622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.705869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.706508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.707354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:53.707354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:53.708890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:53.721796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1131/2261] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:49:53.725955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:53.743224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498602e-3a96-499f-a47d-47459479280e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:53.748650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb355-07ae-44ce-bffe-aee01f808b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:53.749326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb355-07ae-44ce-bffe-aee01f808b43 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.749603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb355-07ae-44ce-bffe-aee01f808b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.749876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0bb355-07ae-44ce-bffe-aee01f808b43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.750602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bb355-07ae-44ce-bffe-aee01f808b43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:53.752505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0bb355-07ae-44ce-bffe-aee01f808b43 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:53.825839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:53.827983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:53.842077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833f3fa-be92-4cb5-bbe3-e0e7f777d5e3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:53.847733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:53.851038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.855024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.855024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] PATH_INFO: `/v3/projects/578b43874bb54c5dad3c417c58a3f3c3` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.855024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578b43874bb54c5dad3c417c58a3f3c3)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:53.858217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:53.862751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1131/2262] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:53 2022] POST /identity/v3/projects => generated 369 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:53.864260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb355-07ae-44ce-bffe-aee01f808b43 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:53.959135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0bb355-07ae-44ce-bffe-aee01f808b43 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:53.968164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623007a8-ddf7-4cc6-be88-8d8f261483c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:53.969406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623007a8-ddf7-4cc6-be88-8d8f261483c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:53.969693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623007a8-ddf7-4cc6-be88-8d8f261483c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:53.969971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623007a8-ddf7-4cc6-be88-8d8f261483c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:53.970748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623007a8-ddf7-4cc6-be88-8d8f261483c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:53.974220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623007a8-ddf7-4cc6-be88-8d8f261483c8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.013579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578b43874bb54c5dad3c417c58a3f3c3', 'request_id': 'req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.020476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578b43874bb54c5dad3c417c58a3f3c3', 'request_id': 'req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.090456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1132/2263] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:53 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:54.091490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623007a8-ddf7-4cc6-be88-8d8f261483c8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.101160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623007a8-ddf7-4cc6-be88-8d8f261483c8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.109570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578b43874bb54c5dad3c417c58a3f3c3', 'request_id': 'req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.125780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] The token cache is being invalidate because project 578b43874bb54c5dad3c417c58a3f3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:54.126076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.126845 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.131925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1132/2264] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:53 2022] DELETE /identity/v3/projects/578b43874bb54c5dad3c417c58a3f3c3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:54.131925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.131925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.172077 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db63522-7f00-45af-8e6f-597287933612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.172921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63522-7f00-45af-8e6f-597287933612 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.173304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63522-7f00-45af-8e6f-597287933612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.173758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db63522-7f00-45af-8e6f-597287933612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.175600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db63522-7f00-45af-8e6f-597287933612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.177471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db63522-7f00-45af-8e6f-597287933612 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.188970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1133/2265] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:54.192288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ec8d-ff46-4e32-8a20-3b2c116984a3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.192471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ec8d-ff46-4e32-8a20-3b2c116984a3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.192662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ec8d-ff46-4e32-8a20-3b2c116984a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.206982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:54.212460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25d05a-bd50-409b-b4f8-207ff8ccbb38 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.216224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5443ec8d-ff46-4e32-8a20-3b2c116984a3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:54.218573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5443ec8d-ff46-4e32-8a20-3b2c116984a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.223608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.224774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.225334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.225961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] PATH_INFO: `/v3/projects/a3a2db6455c348f3897b9cb8cf57d2d5` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.228412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3a2db6455c348f3897b9cb8cf57d2d5)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.231143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1134/2266] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:54.231143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ec8d-ff46-4e32-8a20-3b2c116984a3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.238950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5443ec8d-ff46-4e32-8a20-3b2c116984a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.239252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.248501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5443ec8d-ff46-4e32-8a20-3b2c116984a3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.254701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b738f-b2a7-414a-a541-8f89532f2771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.255383 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b738f-b2a7-414a-a541-8f89532f2771 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.255662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b738f-b2a7-414a-a541-8f89532f2771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.255931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b738f-b2a7-414a-a541-8f89532f2771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.256833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b738f-b2a7-414a-a541-8f89532f2771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.259037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b738f-b2a7-414a-a541-8f89532f2771 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.270989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1135/2267] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:54.272583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983024-c629-4ad7-820d-48604ca2496b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.275176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983024-c629-4ad7-820d-48604ca2496b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.275176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26983024-c629-4ad7-820d-48604ca2496b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.302923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-26983024-c629-4ad7-820d-48604ca2496b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:54.302923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-26983024-c629-4ad7-820d-48604ca2496b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.305037 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1136/2268] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:54.305800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983024-c629-4ad7-820d-48604ca2496b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.315295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26983024-c629-4ad7-820d-48604ca2496b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.319940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9f48b-64cc-4c5c-8828-f47dff1d7917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.321440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f48b-64cc-4c5c-8828-f47dff1d7917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.321718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f48b-64cc-4c5c-8828-f47dff1d7917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.321991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9f48b-64cc-4c5c-8828-f47dff1d7917 admin admin] PATH_INFO: `/v3/projects/d6cc833734e44b588c6d0d52c3ca7b84/users/160c6175803b45bf80591084ad4e92ba/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.337394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9f48b-64cc-4c5c-8828-f47dff1d7917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6cc833734e44b588c6d0d52c3ca7b84, user_id=160c6175803b45bf80591084ad4e92ba, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.340080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9f48b-64cc-4c5c-8828-f47dff1d7917 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.435731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1137/2269] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:54 2022] PUT /identity/v3/projects/d6cc833734e44b588c6d0d52c3ca7b84/users/160c6175803b45bf80591084ad4e92ba/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:54.442324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9f48b-64cc-4c5c-8828-f47dff1d7917 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.450936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3a2db6455c348f3897b9cb8cf57d2d5', 'request_id': 'req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.456803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3a2db6455c348f3897b9cb8cf57d2d5', 'request_id': 'req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.506222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9f48b-64cc-4c5c-8828-f47dff1d7917 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.514773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3a2db6455c348f3897b9cb8cf57d2d5', 'request_id': 'req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.526588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] The token cache is being invalidate because project a3a2db6455c348f3897b9cb8cf57d2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:49:54.526879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.527512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0f5bfec2-48ca-4366-9a6e-8757ec616b9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:49:54.530164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1133/2270] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:49:54 2022] DELETE /identity/v3/projects/a3a2db6455c348f3897b9cb8cf57d2d5 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:54.538786 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42bd23-329e-42b8-9aa6-d7af26e3db1f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.539241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42bd23-329e-42b8-9aa6-d7af26e3db1f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.539736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42bd23-329e-42b8-9aa6-d7af26e3db1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.560232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5f42bd23-329e-42b8-9aa6-d7af26e3db1f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:54.562065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5f42bd23-329e-42b8-9aa6-d7af26e3db1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.567994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ae80e-3361-4698-87cd-dc113abae1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.568680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae80e-3361-4698-87cd-dc113abae1fc admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.568995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae80e-3361-4698-87cd-dc113abae1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.569392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ae80e-3361-4698-87cd-dc113abae1fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.570123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae80e-3361-4698-87cd-dc113abae1fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:54.572352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae80e-3361-4698-87cd-dc113abae1fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.574099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ae80e-3361-4698-87cd-dc113abae1fc admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.592813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1138/2271] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:49:54.594386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfb415-bc65-46f6-92e6-24979aa0c37f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.594797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfb415-bc65-46f6-92e6-24979aa0c37f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.595208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfb415-bc65-46f6-92e6-24979aa0c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.613031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8dcfb415-bc65-46f6-92e6-24979aa0c37f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:54.614235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8dcfb415-bc65-46f6-92e6-24979aa0c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.623095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1139/2272] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:54.626572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1134/2273] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:54.626723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfb415-bc65-46f6-92e6-24979aa0c37f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.630545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8dcfb415-bc65-46f6-92e6-24979aa0c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.630850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cf0d7-24c2-4af7-a8f3-7a44e825b34f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.631227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cf0d7-24c2-4af7-a8f3-7a44e825b34f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.633741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cf0d7-24c2-4af7-a8f3-7a44e825b34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.643547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfb415-bc65-46f6-92e6-24979aa0c37f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.648178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec12d37-7b06-4d31-9ee3-1ffaac115285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.648988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec12d37-7b06-4d31-9ee3-1ffaac115285 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.649257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec12d37-7b06-4d31-9ee3-1ffaac115285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.649527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec12d37-7b06-4d31-9ee3-1ffaac115285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.650263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec12d37-7b06-4d31-9ee3-1ffaac115285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.651879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5a6cf0d7-24c2-4af7-a8f3-7a44e825b34f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:54.652204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec12d37-7b06-4d31-9ee3-1ffaac115285 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.653065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5a6cf0d7-24c2-4af7-a8f3-7a44e825b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.661760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1135/2274] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:54.662837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cf0d7-24c2-4af7-a8f3-7a44e825b34f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.664119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5a6cf0d7-24c2-4af7-a8f3-7a44e825b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:54.720878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cf0d7-24c2-4af7-a8f3-7a44e825b34f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.724651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76686f6-a70c-4aa0-b47b-a43be04d9afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.725292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76686f6-a70c-4aa0-b47b-a43be04d9afd service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.725571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76686f6-a70c-4aa0-b47b-a43be04d9afd service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.725844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76686f6-a70c-4aa0-b47b-a43be04d9afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.735532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76686f6-a70c-4aa0-b47b-a43be04d9afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.736955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76686f6-a70c-4aa0-b47b-a43be04d9afd service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.747180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1136/2275] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:54.747963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76686f6-a70c-4aa0-b47b-a43be04d9afd service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.758943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76686f6-a70c-4aa0-b47b-a43be04d9afd service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.764983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.764983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.765328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.765636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.766247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:49:54.766582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.768239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.773411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1140/2276] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/projects => generated 399 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:54.776748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec12d37-7b06-4d31-9ee3-1ffaac115285 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.785844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1137/2277] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:49:54.790870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.800695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9ec2c-bd99-4caa-bf1d-b3660b2880cb admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.845236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec12d37-7b06-4d31-9ee3-1ffaac115285 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.850855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81547cc-311e-4779-af8a-3f7fd54525e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.851677 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81547cc-311e-4779-af8a-3f7fd54525e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.851965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81547cc-311e-4779-af8a-3f7fd54525e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.852438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81547cc-311e-4779-af8a-3f7fd54525e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.853278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81547cc-311e-4779-af8a-3f7fd54525e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.855283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81547cc-311e-4779-af8a-3f7fd54525e6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.861517 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5f663-0354-4716-8d1f-6aafd3283126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.862350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5f663-0354-4716-8d1f-6aafd3283126 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.862760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5f663-0354-4716-8d1f-6aafd3283126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.863168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5f663-0354-4716-8d1f-6aafd3283126 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.863930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5f663-0354-4716-8d1f-6aafd3283126 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.865892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5f663-0354-4716-8d1f-6aafd3283126 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.961774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1141/2278] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:54.965487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81547cc-311e-4779-af8a-3f7fd54525e6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:54.975652 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81547cc-311e-4779-af8a-3f7fd54525e6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:54.981984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d35fd-8087-4533-82e4-bd79c28fc360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:54.983099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d35fd-8087-4533-82e4-bd79c28fc360 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:54.983393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d35fd-8087-4533-82e4-bd79c28fc360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:54.983674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d35fd-8087-4533-82e4-bd79c28fc360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:54.984416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d35fd-8087-4533-82e4-bd79c28fc360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:54.986056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d35fd-8087-4533-82e4-bd79c28fc360 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:54.996423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1138/2279] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:54.997329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5f663-0354-4716-8d1f-6aafd3283126 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:55.000651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1142/2280] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:49:55.001474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d35fd-8087-4533-82e4-bd79c28fc360 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:55.011693 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d35fd-8087-4533-82e4-bd79c28fc360 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.072285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5f663-0354-4716-8d1f-6aafd3283126 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.077107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74506fa-df84-41db-b9f8-d1d6151058a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.077783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74506fa-df84-41db-b9f8-d1d6151058a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.078067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74506fa-df84-41db-b9f8-d1d6151058a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.078368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74506fa-df84-41db-b9f8-d1d6151058a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.079069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74506fa-df84-41db-b9f8-d1d6151058a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.081012 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74506fa-df84-41db-b9f8-d1d6151058a3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:55.086253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116475a-478e-469b-ae54-77dcf8fc1724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.087858 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116475a-478e-469b-ae54-77dcf8fc1724 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.090020 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:55.091713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116475a-478e-469b-ae54-77dcf8fc1724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.091713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116475a-478e-469b-ae54-77dcf8fc1724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.092450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116475a-478e-469b-ae54-77dcf8fc1724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.104513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116475a-478e-469b-ae54-77dcf8fc1724 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:55.121775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1143/2281] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:49:55.126299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116475a-478e-469b-ae54-77dcf8fc1724 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:55.151709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116475a-478e-469b-ae54-77dcf8fc1724 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.159834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b39832-e13a-4fe5-92f6-e16d283ac988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.162192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b39832-e13a-4fe5-92f6-e16d283ac988 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.162192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b39832-e13a-4fe5-92f6-e16d283ac988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.162192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b39832-e13a-4fe5-92f6-e16d283ac988 admin admin] PATH_INFO: `/v3/projects/2cda8c058d794cbe8531a5a12e66e4ce/users/92ced2ea2cbc4559a24ebc8535088714/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.184252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b39832-e13a-4fe5-92f6-e16d283ac988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cda8c058d794cbe8531a5a12e66e4ce, user_id=92ced2ea2cbc4559a24ebc8535088714, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.187223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b39832-e13a-4fe5-92f6-e16d283ac988 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:55.200994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1139/2282] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:54 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:55.204852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74506fa-df84-41db-b9f8-d1d6151058a3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:55.217088 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74506fa-df84-41db-b9f8-d1d6151058a3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.224996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5daaf-e747-42e5-9add-5b7b27066439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.225744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5daaf-e747-42e5-9add-5b7b27066439 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.225970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5daaf-e747-42e5-9add-5b7b27066439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.226932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5daaf-e747-42e5-9add-5b7b27066439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.227916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5daaf-e747-42e5-9add-5b7b27066439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.230040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5daaf-e747-42e5-9add-5b7b27066439 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:55.241541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1140/2283] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:49:55.252045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5daaf-e747-42e5-9add-5b7b27066439 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:55.262053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5daaf-e747-42e5-9add-5b7b27066439 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.266799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f71451-61d3-4b2f-8874-ca63a8b6d8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.267557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f71451-61d3-4b2f-8874-ca63a8b6d8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.267830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f71451-61d3-4b2f-8874-ca63a8b6d8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.268111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f71451-61d3-4b2f-8874-ca63a8b6d8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.268833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f71451-61d3-4b2f-8874-ca63a8b6d8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.270475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f71451-61d3-4b2f-8874-ca63a8b6d8e6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:55.285030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1144/2284] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:55 2022] PUT /identity/v3/projects/2cda8c058d794cbe8531a5a12e66e4ce/users/92ced2ea2cbc4559a24ebc8535088714/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:49:55.293985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1141/2285] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:49:55.298967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b39832-e13a-4fe5-92f6-e16d283ac988 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:55.299468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee822ed1-a21d-4c3b-93a8-d19fb1f13bc5 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.299762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee822ed1-a21d-4c3b-93a8-d19fb1f13bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.300043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee822ed1-a21d-4c3b-93a8-d19fb1f13bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.336422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ee822ed1-a21d-4c3b-93a8-d19fb1f13bc5 None None] MFA Rules not processed for user `92ced2ea2cbc4559a24ebc8535088714`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:55.337826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ee822ed1-a21d-4c3b-93a8-d19fb1f13bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:55.432557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b39832-e13a-4fe5-92f6-e16d283ac988 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.447751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d8aef-41d9-4868-a12f-87b418bcd653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.448764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d8aef-41d9-4868-a12f-87b418bcd653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.449058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d8aef-41d9-4868-a12f-87b418bcd653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.449342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d8aef-41d9-4868-a12f-87b418bcd653 admin admin] PATH_INFO: `/v3/projects/e3a657b5c9eb4b9d901a334ce01d4343/users/0dcaaade861d4c9b86ea54764d01936c/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.461077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1142/2286] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:55.471920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d8aef-41d9-4868-a12f-87b418bcd653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a657b5c9eb4b9d901a334ce01d4343, user_id=0dcaaade861d4c9b86ea54764d01936c, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.477773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee822ed1-a21d-4c3b-93a8-d19fb1f13bc5 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:55.479501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ee822ed1-a21d-4c3b-93a8-d19fb1f13bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:55.500154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d8aef-41d9-4868-a12f-87b418bcd653 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:55.581098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee822ed1-a21d-4c3b-93a8-d19fb1f13bc5 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.585414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905304f3-1437-4679-832c-b44005770da3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.586860 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905304f3-1437-4679-832c-b44005770da3 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.587242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905304f3-1437-4679-832c-b44005770da3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.587527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905304f3-1437-4679-832c-b44005770da3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.603756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905304f3-1437-4679-832c-b44005770da3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.605506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905304f3-1437-4679-832c-b44005770da3 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:55.616658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1143/2287] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:55.656251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1145/2288] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:55 2022] PUT /identity/v3/projects/e3a657b5c9eb4b9d901a334ce01d4343/users/0dcaaade861d4c9b86ea54764d01936c/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:55.658265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e9675-2a72-46d9-bfd1-83404b7db9f8 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.658601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e9675-2a72-46d9-bfd1-83404b7db9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.658885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e9675-2a72-46d9-bfd1-83404b7db9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.705196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ba66-7699-40f8-999f-16f8d835d23f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.705485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ba66-7699-40f8-999f-16f8d835d23f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.705768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d0ba66-7699-40f8-999f-16f8d835d23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.728650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-405e9675-2a72-46d9-bfd1-83404b7db9f8 None None] MFA Rules not processed for user `0dcaaade861d4c9b86ea54764d01936c`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:55.730549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-405e9675-2a72-46d9-bfd1-83404b7db9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:55.745545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-66d0ba66-7699-40f8-999f-16f8d835d23f None None] MFA Rules not processed for user `b760cb7932fc4b3ea0d3e7526f15be0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:55.746873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-66d0ba66-7699-40f8-999f-16f8d835d23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:55.763877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:55.845917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1146/2289] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:55.848260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1144/2290] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:49:55.855937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ba66-7699-40f8-999f-16f8d835d23f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:55.952150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d0ba66-7699-40f8-999f-16f8d835d23f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:55.957423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ec382-5b45-4952-b630-8c43674e8688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:55.958147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ec382-5b45-4952-b630-8c43674e8688 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:55.958434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ec382-5b45-4952-b630-8c43674e8688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:55.958838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ec382-5b45-4952-b630-8c43674e8688 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:55.961947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:55.969566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ec382-5b45-4952-b630-8c43674e8688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:55.973168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32ec382-5b45-4952-b630-8c43674e8688 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:56.090379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1147/2291] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:49:55 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:49:56.094297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e9675-2a72-46d9-bfd1-83404b7db9f8 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:56.109546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e9675-2a72-46d9-bfd1-83404b7db9f8 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:56.173190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d7d8b-aade-496b-a86b-4a17ee9bf92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:56.174078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7d8b-aade-496b-a86b-4a17ee9bf92b admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:56.174366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7d8b-aade-496b-a86b-4a17ee9bf92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:56.174682 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d7d8b-aade-496b-a86b-4a17ee9bf92b admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:56.175438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d7d8b-aade-496b-a86b-4a17ee9bf92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:56.177372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d7d8b-aade-496b-a86b-4a17ee9bf92b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:56.345776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1145/2292] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:49:56 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:49:56.349672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ec382-5b45-4952-b630-8c43674e8688 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:56.366512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ec382-5b45-4952-b630-8c43674e8688 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:56.375731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6c4f3-684f-4920-857a-307c9c81ab23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:56.375731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c4f3-684f-4920-857a-307c9c81ab23 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:56.375731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c4f3-684f-4920-857a-307c9c81ab23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:56.375731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6c4f3-684f-4920-857a-307c9c81ab23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:56.376157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6c4f3-684f-4920-857a-307c9c81ab23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:56.377072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6c4f3-684f-4920-857a-307c9c81ab23 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:56.390963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1148/2293] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:56.394965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d7d8b-aade-496b-a86b-4a17ee9bf92b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:56.418159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d7d8b-aade-496b-a86b-4a17ee9bf92b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:56.423621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e5e6c-94b1-49d9-b27a-5106b4583aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:56.424557 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5e6c-94b1-49d9-b27a-5106b4583aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:56.424843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5e6c-94b1-49d9-b27a-5106b4583aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:56.425122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5e6c-94b1-49d9-b27a-5106b4583aa3 admin admin] PATH_INFO: `/v3/projects/277c86082a9c4c51aa4f2bd35e25d875/users/a6e3e35288ac4f48874e8c454ccd9030/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:56.442004 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e5e6c-94b1-49d9-b27a-5106b4583aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277c86082a9c4c51aa4f2bd35e25d875, user_id=a6e3e35288ac4f48874e8c454ccd9030, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:56.445224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e5e6c-94b1-49d9-b27a-5106b4583aa3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:56.571357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1146/2294] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:56 2022] PUT /identity/v3/projects/277c86082a9c4c51aa4f2bd35e25d875/users/a6e3e35288ac4f48874e8c454ccd9030/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:56.574921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6c4f3-684f-4920-857a-307c9c81ab23 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:56.595866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6c4f3-684f-4920-857a-307c9c81ab23 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:56.746565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec116e75-7032-464c-be82-1ee1592b7557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:56.747346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116e75-7032-464c-be82-1ee1592b7557 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:56.747630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116e75-7032-464c-be82-1ee1592b7557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:56.748148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec116e75-7032-464c-be82-1ee1592b7557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:56.748676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec116e75-7032-464c-be82-1ee1592b7557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:56.751542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec116e75-7032-464c-be82-1ee1592b7557 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:56.765083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1149/2295] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:49:56 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:49:56.772245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e5e6c-94b1-49d9-b27a-5106b4583aa3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:56.783955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e5e6c-94b1-49d9-b27a-5106b4583aa3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:56.789728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da4fb-43b2-45dc-89e9-e7deaf562d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:56.790664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da4fb-43b2-45dc-89e9-e7deaf562d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:56.790948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da4fb-43b2-45dc-89e9-e7deaf562d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:56.791228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4da4fb-43b2-45dc-89e9-e7deaf562d33 admin admin] PATH_INFO: `/v3/projects/277c86082a9c4c51aa4f2bd35e25d875/users/a6e3e35288ac4f48874e8c454ccd9030/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:56.793246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da4fb-43b2-45dc-89e9-e7deaf562d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=277c86082a9c4c51aa4f2bd35e25d875, user_id=a6e3e35288ac4f48874e8c454ccd9030, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:56.796081 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4da4fb-43b2-45dc-89e9-e7deaf562d33 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:56.810640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1147/2296] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:49:56 2022] PUT /identity/v3/projects/277c86082a9c4c51aa4f2bd35e25d875/users/a6e3e35288ac4f48874e8c454ccd9030/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:49:56.818857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7e9af-232a-4c1a-89a9-a80efec460a3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:56.819124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7e9af-232a-4c1a-89a9-a80efec460a3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:56.819407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f7e9af-232a-4c1a-89a9-a80efec460a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:56.880598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-44f7e9af-232a-4c1a-89a9-a80efec460a3 None None] MFA Rules not processed for user `a6e3e35288ac4f48874e8c454ccd9030`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:56.882095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-44f7e9af-232a-4c1a-89a9-a80efec460a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:56.990706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1150/2297] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:56.998103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da4fb-43b2-45dc-89e9-e7deaf562d33 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:49:57.081490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4da4fb-43b2-45dc-89e9-e7deaf562d33 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:49:57.086681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e414f4-12e1-43ac-9143-b9c4154d7bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:49:57.087469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e414f4-12e1-43ac-9143-b9c4154d7bfe service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:57.087878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e414f4-12e1-43ac-9143-b9c4154d7bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:57.088259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e414f4-12e1-43ac-9143-b9c4154d7bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:57.146667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e414f4-12e1-43ac-9143-b9c4154d7bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:49:57.148918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e414f4-12e1-43ac-9143-b9c4154d7bfe service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:49:57.158864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1148/2298] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:49:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:49:57.910672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=80,keystone:DELETE=14,keystone:INSERT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:49:58.899253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583419c3-0089-45d6-a050-dd448d844feb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:49:58.899789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583419c3-0089-45d6-a050-dd448d844feb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:49:58.900158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583419c3-0089-45d6-a050-dd448d844feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:49:58.938144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-583419c3-0089-45d6-a050-dd448d844feb None None] MFA Rules not processed for user `e24e8e8d0b8042bfb7ee7881aa8a16c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:49:58.941142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-583419c3-0089-45d6-a050-dd448d844feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:49:59.071075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1151/2299] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:49:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:49:59.483885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:01.205803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:02.098910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:02.416664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:02.732616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16fe3a-bf77-4669-9099-7b5eaa4b0254 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:02.732829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16fe3a-bf77-4669-9099-7b5eaa4b0254 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:02.733127 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b16fe3a-bf77-4669-9099-7b5eaa4b0254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:02.766452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5b16fe3a-bf77-4669-9099-7b5eaa4b0254 None None] MFA Rules not processed for user `160c6175803b45bf80591084ad4e92ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:02.767616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5b16fe3a-bf77-4669-9099-7b5eaa4b0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:02.913565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1149/2300] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:02.919245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583419c3-0089-45d6-a050-dd448d844feb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:02.923585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-583419c3-0089-45d6-a050-dd448d844feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:03.104394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583419c3-0089-45d6-a050-dd448d844feb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:03.104394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e601fcb-0c09-42bc-b7ed-2ec9b5de0f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:03.104394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e601fcb-0c09-42bc-b7ed-2ec9b5de0f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:03.104394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e601fcb-0c09-42bc-b7ed-2ec9b5de0f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:03.104927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e601fcb-0c09-42bc-b7ed-2ec9b5de0f0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:03.104927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e601fcb-0c09-42bc-b7ed-2ec9b5de0f0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:03.104927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e601fcb-0c09-42bc-b7ed-2ec9b5de0f0d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:03.612700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16fe3a-bf77-4669-9099-7b5eaa4b0254 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:03.619165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1152/2301] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:50:02 2022] POST /identity/v3/projects => generated 373 bytes in 700 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:03.632274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b16fe3a-bf77-4669-9099-7b5eaa4b0254 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:03.701379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7bc9a-91a3-47c1-be59-3462723649ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:03.702166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7bc9a-91a3-47c1-be59-3462723649ab admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:03.702558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7bc9a-91a3-47c1-be59-3462723649ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:03.702913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7bc9a-91a3-47c1-be59-3462723649ab admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:03.703714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7bc9a-91a3-47c1-be59-3462723649ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:03.705832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c7bc9a-91a3-47c1-be59-3462723649ab admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:03.825171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1150/2302] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:50:03 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:03.827026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e601fcb-0c09-42bc-b7ed-2ec9b5de0f0d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:03.842818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e601fcb-0c09-42bc-b7ed-2ec9b5de0f0d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:03.847575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac053fa7-5cfd-49c9-9da8-d05102760ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:03.848777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac053fa7-5cfd-49c9-9da8-d05102760ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:03.848909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac053fa7-5cfd-49c9-9da8-d05102760ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:03.849127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac053fa7-5cfd-49c9-9da8-d05102760ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:03.851328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac053fa7-5cfd-49c9-9da8-d05102760ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:03.853158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac053fa7-5cfd-49c9-9da8-d05102760ec4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:03.869887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1153/2303] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:03.873312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7bc9a-91a3-47c1-be59-3462723649ab admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:03.885581 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7bc9a-91a3-47c1-be59-3462723649ab admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:03.909985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3779671-df18-437e-ad6b-f315afdfa87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:03.911110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3779671-df18-437e-ad6b-f315afdfa87b admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:03.911499 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3779671-df18-437e-ad6b-f315afdfa87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:03.911870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3779671-df18-437e-ad6b-f315afdfa87b admin admin] PATH_INFO: `/v3/projects/8f7f589fa7b3458d80e8c907be67ac0a/users/4d7ff87a43e440d78fcc4caf18e26ab9/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:03.937798 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3779671-df18-437e-ad6b-f315afdfa87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7f589fa7b3458d80e8c907be67ac0a, user_id=4d7ff87a43e440d78fcc4caf18e26ab9, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:03.940944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3779671-df18-437e-ad6b-f315afdfa87b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:04.050760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1151/2304] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:03 2022] PUT /identity/v3/projects/8f7f589fa7b3458d80e8c907be67ac0a/users/4d7ff87a43e440d78fcc4caf18e26ab9/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:50:04.054806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac053fa7-5cfd-49c9-9da8-d05102760ec4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:04.065167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac053fa7-5cfd-49c9-9da8-d05102760ec4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:04.127741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8244ac-88f7-48ed-b395-4ba6d5bb98af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:04.128856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8244ac-88f7-48ed-b395-4ba6d5bb98af admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:04.129292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8244ac-88f7-48ed-b395-4ba6d5bb98af admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:04.129717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8244ac-88f7-48ed-b395-4ba6d5bb98af admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:04.130631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8244ac-88f7-48ed-b395-4ba6d5bb98af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:04.133479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8244ac-88f7-48ed-b395-4ba6d5bb98af admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:04.145063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1154/2305] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:04.149734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3779671-df18-437e-ad6b-f315afdfa87b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:04.160883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3779671-df18-437e-ad6b-f315afdfa87b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:04.167515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da561c7d-bb4c-45b6-8d9b-66a4c660ef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:04.168533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561c7d-bb4c-45b6-8d9b-66a4c660ef99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:04.168994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561c7d-bb4c-45b6-8d9b-66a4c660ef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:04.169344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da561c7d-bb4c-45b6-8d9b-66a4c660ef99 admin admin] PATH_INFO: `/v3/projects/8f7f589fa7b3458d80e8c907be67ac0a/users/4d7ff87a43e440d78fcc4caf18e26ab9/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:04.171603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da561c7d-bb4c-45b6-8d9b-66a4c660ef99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7f589fa7b3458d80e8c907be67ac0a, user_id=4d7ff87a43e440d78fcc4caf18e26ab9, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:04.174784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:04.175030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da561c7d-bb4c-45b6-8d9b-66a4c660ef99 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:04.186974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1152/2306] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:04 2022] PUT /identity/v3/projects/8f7f589fa7b3458d80e8c907be67ac0a/users/4d7ff87a43e440d78fcc4caf18e26ab9/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:50:04.348450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:05.953642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:07.032912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:08.958981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8244ac-88f7-48ed-b395-4ba6d5bb98af admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:08.976304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8244ac-88f7-48ed-b395-4ba6d5bb98af admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:09.063527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:09.064895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:09.065394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:09.065882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] PATH_INFO: `/v3/users/92ced2ea2cbc4559a24ebc8535088714` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:09.067481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92ced2ea2cbc4559a24ebc8535088714)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:09.069905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:09.423022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92ced2ea2cbc4559a24ebc8535088714'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:09.424017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92ced2ea2cbc4559a24ebc8535088714'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:09.424743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92ced2ea2cbc4559a24ebc8535088714'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:09.438408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:09.465496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92ced2ea2cbc4559a24ebc8535088714'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:09.484765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92ced2ea2cbc4559a24ebc8535088714'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:09.624283 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b7cf-9890-412b-adfe-9dd438344603 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:09.625756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b7cf-9890-412b-adfe-9dd438344603 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:09.626243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1155/2307] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:50:08 2022] DELETE /identity/v3/users/92ced2ea2cbc4559a24ebc8535088714 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:09.626447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230b7cf-9890-412b-adfe-9dd438344603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:09.655187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-6230b7cf-9890-412b-adfe-9dd438344603 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:09.656726 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6230b7cf-9890-412b-adfe-9dd438344603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:09.793844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:09.810674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1153/2308] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:09.830207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:09.831765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:09.982301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f597d-9744-453a-8438-27e0744fab94 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:09.997511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:10.000144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:10.001225 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:10.002673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:10.025627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:10.027558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:10.061494 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230b7cf-9890-412b-adfe-9dd438344603 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:10.064480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6230b7cf-9890-412b-adfe-9dd438344603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:10.064619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1156/2309] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:10.199241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230b7cf-9890-412b-adfe-9dd438344603 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:10.206296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f6bc2-3b53-45c4-a96d-354f06518ad3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:10.207761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6bc2-3b53-45c4-a96d-354f06518ad3 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:10.208525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6bc2-3b53-45c4-a96d-354f06518ad3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:10.210948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f6bc2-3b53-45c4-a96d-354f06518ad3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:10.213679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0a7f6bc2-3b53-45c4-a96d-354f06518ad3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:10.354151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f6bc2-3b53-45c4-a96d-354f06518ad3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:10.357080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f6bc2-3b53-45c4-a96d-354f06518ad3 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:10.374655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1154/2310] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:50:10.693650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:11.771584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:11.773084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:11.810135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d895413e-2ef7-4ada-a98f-68a02d3df611 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:11.823414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:11.824606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:11.826428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:11.827012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] PATH_INFO: `/v3/projects/2cda8c058d794cbe8531a5a12e66e4ce` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:11.833348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cda8c058d794cbe8531a5a12e66e4ce)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:11.836869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.079330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cda8c058d794cbe8531a5a12e66e4ce', 'request_id': 'req-750521d7-114a-46c5-92d2-403e955a6557'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:12.088793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cda8c058d794cbe8531a5a12e66e4ce', 'request_id': 'req-750521d7-114a-46c5-92d2-403e955a6557'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:12.096010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cda8c058d794cbe8531a5a12e66e4ce', 'request_id': 'req-750521d7-114a-46c5-92d2-403e955a6557'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:12.200038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] The token cache is being invalidate because project 2cda8c058d794cbe8531a5a12e66e4ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:12.200038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:12.200985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-750521d7-114a-46c5-92d2-403e955a6557 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:12.204888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1157/2311] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:50:11 2022] DELETE /identity/v3/projects/2cda8c058d794cbe8531a5a12e66e4ce => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:12.211185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c8d0-a452-473b-8aba-77a5b5ea054b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.211734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c8d0-a452-473b-8aba-77a5b5ea054b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.211734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49c8d0-a452-473b-8aba-77a5b5ea054b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.242786 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ab49c8d0-a452-473b-8aba-77a5b5ea054b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:12.244525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ab49c8d0-a452-473b-8aba-77a5b5ea054b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:12.367552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1155/2312] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:12.368561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f5de-e5ee-4d1e-8099-e388a98e5e7e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.368853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f5de-e5ee-4d1e-8099-e388a98e5e7e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.369128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214f5de-e5ee-4d1e-8099-e388a98e5e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.408322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c214f5de-e5ee-4d1e-8099-e388a98e5e7e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:12.408322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c214f5de-e5ee-4d1e-8099-e388a98e5e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:12.421149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1158/2313] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:12.427089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c8d0-a452-473b-8aba-77a5b5ea054b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.443009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49c8d0-a452-473b-8aba-77a5b5ea054b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:12.449980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:12.450920 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.451459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.451802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.452763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:50:12.453276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:12.458909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.480988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1156/2314] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:50:12.492454 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214f5de-e5ee-4d1e-8099-e388a98e5e7e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.507542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214f5de-e5ee-4d1e-8099-e388a98e5e7e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:12.514008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b28f26-3b1d-4e08-b1a8-7a0618526563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:12.514774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28f26-3b1d-4e08-b1a8-7a0618526563 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.515059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28f26-3b1d-4e08-b1a8-7a0618526563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.515585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b28f26-3b1d-4e08-b1a8-7a0618526563 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.516479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28f26-3b1d-4e08-b1a8-7a0618526563 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:12.523530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b28f26-3b1d-4e08-b1a8-7a0618526563 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.642241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1159/2315] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:50:12 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:50:12.647240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.666256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d48f8f-618c-4ec1-8b71-fd02a24bad1f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:12.690645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f6012-357e-40fd-9bd9-891939d7d230 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.691172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f6012-357e-40fd-9bd9-891939d7d230 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.692283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f6012-357e-40fd-9bd9-891939d7d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.772987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-014f6012-357e-40fd-9bd9-891939d7d230 None None] MFA Rules not processed for user `4d7ff87a43e440d78fcc4caf18e26ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:12.774211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-014f6012-357e-40fd-9bd9-891939d7d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:12.811049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5608d-a54e-4ece-b4de-1f33e73f7192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:12.811754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5608d-a54e-4ece-b4de-1f33e73f7192 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.812059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5608d-a54e-4ece-b4de-1f33e73f7192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.812344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d5608d-a54e-4ece-b4de-1f33e73f7192 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.813052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5608d-a54e-4ece-b4de-1f33e73f7192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:12.817700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d5608d-a54e-4ece-b4de-1f33e73f7192 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:12.898605 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1160/2316] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:12.914317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f6012-357e-40fd-9bd9-891939d7d230 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.918821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-014f6012-357e-40fd-9bd9-891939d7d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:12.948172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1157/2317] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:50:12 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:12.952724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5608d-a54e-4ece-b4de-1f33e73f7192 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:12.971655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d5608d-a54e-4ece-b4de-1f33e73f7192 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:12.977583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e06e6-46d8-4194-9530-bbadcf120260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:12.978538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e06e6-46d8-4194-9530-bbadcf120260 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:12.978933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e06e6-46d8-4194-9530-bbadcf120260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:12.979275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e06e6-46d8-4194-9530-bbadcf120260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:12.980070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e06e6-46d8-4194-9530-bbadcf120260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:12.982019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e06e6-46d8-4194-9530-bbadcf120260 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:13.000640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1158/2318] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:13.005188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e06e6-46d8-4194-9530-bbadcf120260 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:13.016182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e06e6-46d8-4194-9530-bbadcf120260 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:13.026307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af556187-60a6-4547-864d-f03a9cd2f0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:13.027144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556187-60a6-4547-864d-f03a9cd2f0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:13.027501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556187-60a6-4547-864d-f03a9cd2f0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:13.028280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af556187-60a6-4547-864d-f03a9cd2f0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:13.031617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af556187-60a6-4547-864d-f03a9cd2f0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:13.033781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af556187-60a6-4547-864d-f03a9cd2f0c6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:13.053307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1159/2319] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:13.056841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af556187-60a6-4547-864d-f03a9cd2f0c6 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:13.070109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f6012-357e-40fd-9bd9-891939d7d230 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:13.078435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb0cf7-33a1-4661-9698-0c49a6bc701f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:13.079160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb0cf7-33a1-4661-9698-0c49a6bc701f service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:13.079709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb0cf7-33a1-4661-9698-0c49a6bc701f service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:13.079920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb0cf7-33a1-4661-9698-0c49a6bc701f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:13.083051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5ecb0cf7-33a1-4661-9698-0c49a6bc701f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:13.084221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af556187-60a6-4547-864d-f03a9cd2f0c6 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:13.092690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:13.093636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:13.093990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:13.094236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] PATH_INFO: `/v3/projects/b7059688f7a24761b61e51820c78a2ab/users/db52c21a4c58422fa7ccad6232fc8f21/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:13.119887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7059688f7a24761b61e51820c78a2ab, user_id=db52c21a4c58422fa7ccad6232fc8f21, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:13.123111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:13.206990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb0cf7-33a1-4661-9698-0c49a6bc701f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:13.209408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb0cf7-33a1-4661-9698-0c49a6bc701f service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:13.220437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1161/2320] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:13.245286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1160/2321] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:13 2022] PUT /identity/v3/projects/b7059688f7a24761b61e51820c78a2ab/users/db52c21a4c58422fa7ccad6232fc8f21/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:13.250863 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a1318-d52a-4bc8-b7b5-6873b58a0bd1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:13.251187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a1318-d52a-4bc8-b7b5-6873b58a0bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:13.251429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a1318-d52a-4bc8-b7b5-6873b58a0bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:13.282582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-407a1318-d52a-4bc8-b7b5-6873b58a0bd1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:13.284951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-407a1318-d52a-4bc8-b7b5-6873b58a0bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:13.364080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:13.379834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1162/2322] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:13.389614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:13.391372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:13.457807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a933e0-af24-44b6-9e8e-1770ea7ccc52 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:13.461851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:13.462509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:13.462884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:13.463157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:13.475109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:13.478740 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:13.493361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1161/2323] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:13.603600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:16.295055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:17.286461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82429d-373b-41aa-9ffe-d6d109ff8a99 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:17.287500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82429d-373b-41aa-9ffe-d6d109ff8a99 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:17.287993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82429d-373b-41aa-9ffe-d6d109ff8a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:17.312144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:17.320997 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9c82429d-373b-41aa-9ffe-d6d109ff8a99 None None] MFA Rules not processed for user `160c6175803b45bf80591084ad4e92ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:17.322360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9c82429d-373b-41aa-9ffe-d6d109ff8a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:17.423044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1163/2324] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:19.428390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:19.429906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:19.444401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db241395-ee5c-49f9-aace-358fa65ea294 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:19.455102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:19.457277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:19.457717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:19.458075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] PATH_INFO: `/v3/users/0dcaaade861d4c9b86ea54764d01936c` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:19.459534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcaaade861d4c9b86ea54764d01936c)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:19.461565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:19.721800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcaaade861d4c9b86ea54764d01936c'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:19.722969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcaaade861d4c9b86ea54764d01936c'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:19.733722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcaaade861d4c9b86ea54764d01936c'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:19.757868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcaaade861d4c9b86ea54764d01936c'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:19.759414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcaaade861d4c9b86ea54764d01936c'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:19.865793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1162/2325] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:50:19 2022] DELETE /identity/v3/users/0dcaaade861d4c9b86ea54764d01936c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:19.875596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b68a-fb42-44c4-b3a1-382ebf9347e2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:19.879616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b68a-fb42-44c4-b3a1-382ebf9347e2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:19.879616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384b68a-fb42-44c4-b3a1-382ebf9347e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:19.906878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6384b68a-fb42-44c4-b3a1-382ebf9347e2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:19.908190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6384b68a-fb42-44c4-b3a1-382ebf9347e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:20.010978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1164/2326] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:20.026590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:20.031400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:20.054681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:20.102412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23b4af-b427-4d05-8011-a96ac7034f9c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:20.106909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b41f7-04c3-4615-a4f8-8fc9a63b4efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:20.108241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b41f7-04c3-4615-a4f8-8fc9a63b4efd service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:20.108684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b41f7-04c3-4615-a4f8-8fc9a63b4efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:20.109122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b41f7-04c3-4615-a4f8-8fc9a63b4efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:20.120183 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b41f7-04c3-4615-a4f8-8fc9a63b4efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:20.121998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b41f7-04c3-4615-a4f8-8fc9a63b4efd service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:20.133963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1163/2327] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:20.954763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384b68a-fb42-44c4-b3a1-382ebf9347e2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:20.957536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6384b68a-fb42-44c4-b3a1-382ebf9347e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:20.986980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384b68a-fb42-44c4-b3a1-382ebf9347e2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:20.992297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:20.993877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:20.993877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:20.994076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] PATH_INFO: `/v3/projects/e3a657b5c9eb4b9d901a334ce01d4343` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:20.995798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a657b5c9eb4b9d901a334ce01d4343)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:20.997881 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:21.038444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74f773-c044-4ebc-8867-89b8cb68b819 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:21.039035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74f773-c044-4ebc-8867-89b8cb68b819 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:21.039521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74f773-c044-4ebc-8867-89b8cb68b819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:21.076293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4c74f773-c044-4ebc-8867-89b8cb68b819 None None] MFA Rules not processed for user `db52c21a4c58422fa7ccad6232fc8f21`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:21.093435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4c74f773-c044-4ebc-8867-89b8cb68b819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:21.166417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a657b5c9eb4b9d901a334ce01d4343', 'request_id': 'req-2dff9617-a962-4c38-acc5-e12461d01d51'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.177872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a657b5c9eb4b9d901a334ce01d4343', 'request_id': 'req-2dff9617-a962-4c38-acc5-e12461d01d51'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.194904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1164/2328] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:21.198380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a657b5c9eb4b9d901a334ce01d4343', 'request_id': 'req-2dff9617-a962-4c38-acc5-e12461d01d51'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.204477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74f773-c044-4ebc-8867-89b8cb68b819 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:21.209949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4c74f773-c044-4ebc-8867-89b8cb68b819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:21.225117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c74f773-c044-4ebc-8867-89b8cb68b819 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:21.284737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:21.285478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:21.285925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:21.286205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:21.286937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:21.288858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:21.320226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] The token cache is being invalidate because project e3a657b5c9eb4b9d901a334ce01d4343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:21.320519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.321180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.322923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1165/2329] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:50:20 2022] DELETE /identity/v3/projects/e3a657b5c9eb4b9d901a334ce01d4343 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:21.326962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:21.328521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:21.345397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dff9617-a962-4c38-acc5-e12461d01d51 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:21.355304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:21.356212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:21.356499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:21.356775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] PATH_INFO: `/v3/users/a6e3e35288ac4f48874e8c454ccd9030` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:21.358619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6e3e35288ac4f48874e8c454ccd9030)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:21.365502 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:21.383879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:21.450272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1165/2330] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:50:21 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:21.454221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:21.457437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:21.545341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5908eeb-9654-4341-9c18-15e4afad9a25 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:21.551311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:21.552057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:21.552409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:21.552757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:21.553567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:21.556946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:21.612601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6e3e35288ac4f48874e8c454ccd9030'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.614591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6e3e35288ac4f48874e8c454ccd9030'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.615407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6e3e35288ac4f48874e8c454ccd9030'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.643914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6e3e35288ac4f48874e8c454ccd9030'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.653845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6e3e35288ac4f48874e8c454ccd9030'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:21.661955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1166/2331] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:50:21 2022] POST /identity/v3/users => generated 299 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:50:21.678277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:21.682665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:21.693659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:21.699958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b138fc-e073-4797-a044-cafb67f1d22e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:21.704728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50eb8f-5a2a-47a1-a403-4f5a5251b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:21.705759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50eb8f-5a2a-47a1-a403-4f5a5251b47c admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:21.706112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50eb8f-5a2a-47a1-a403-4f5a5251b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:21.706388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b50eb8f-5a2a-47a1-a403-4f5a5251b47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:21.707151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50eb8f-5a2a-47a1-a403-4f5a5251b47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:21.708885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b50eb8f-5a2a-47a1-a403-4f5a5251b47c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:21.718910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1167/2332] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:21.734065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50eb8f-5a2a-47a1-a403-4f5a5251b47c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:21.748029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b50eb8f-5a2a-47a1-a403-4f5a5251b47c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:21.753977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d1ff-a478-4582-b9a5-4289eae59f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:21.756202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1166/2333] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:50:21 2022] DELETE /identity/v3/users/a6e3e35288ac4f48874e8c454ccd9030 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:50:21.757793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d1ff-a478-4582-b9a5-4289eae59f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:21.758085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d1ff-a478-4582-b9a5-4289eae59f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:21.758369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215d1ff-a478-4582-b9a5-4289eae59f7d admin admin] PATH_INFO: `/v3/projects/e9cad045f0f24aa9811e2933ab77e664/users/fa3ce802f8d44bfd9232dcc4879fcacf/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:21.775223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215d1ff-a478-4582-b9a5-4289eae59f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9cad045f0f24aa9811e2933ab77e664, user_id=fa3ce802f8d44bfd9232dcc4879fcacf, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:21.778111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215d1ff-a478-4582-b9a5-4289eae59f7d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:21.843293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1168/2334] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:21 2022] PUT /identity/v3/projects/e9cad045f0f24aa9811e2933ab77e664/users/fa3ce802f8d44bfd9232dcc4879fcacf/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:50:21.848534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:21.914498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc183b-9aad-4a80-8e79-f182f4842e64 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:21.973361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:21.974318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:21.974624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:21.974899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:21.975670 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:21.977400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:21.994658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1167/2335] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:21.998854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d1ff-a478-4582-b9a5-4289eae59f7d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:22.006430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215d1ff-a478-4582-b9a5-4289eae59f7d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:22.011077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b5406-653f-4ea2-ab6e-de20e121748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:22.011973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b5406-653f-4ea2-ab6e-de20e121748a admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:22.012253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b5406-653f-4ea2-ab6e-de20e121748a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:22.012527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b5406-653f-4ea2-ab6e-de20e121748a admin admin] PATH_INFO: `/v3/projects/e9cad045f0f24aa9811e2933ab77e664/users/fa3ce802f8d44bfd9232dcc4879fcacf/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:22.014478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b5406-653f-4ea2-ab6e-de20e121748a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9cad045f0f24aa9811e2933ab77e664, user_id=fa3ce802f8d44bfd9232dcc4879fcacf, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:22.017160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b5406-653f-4ea2-ab6e-de20e121748a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:22.028313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1169/2336] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:21 2022] PUT /identity/v3/projects/e9cad045f0f24aa9811e2933ab77e664/users/fa3ce802f8d44bfd9232dcc4879fcacf/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:22.271814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:22.273873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:22.292600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30beab-ffa5-4502-aac9-52cdb742e628 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:22.361637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:22.365105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:22.365105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:22.365105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] PATH_INFO: `/v3/projects/277c86082a9c4c51aa4f2bd35e25d875` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:22.365105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=277c86082a9c4c51aa4f2bd35e25d875)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:22.366703 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:22.531926 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '277c86082a9c4c51aa4f2bd35e25d875', 'request_id': 'req-91cf8918-097b-4b8e-8ff5-096ea0188540'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:22.538886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '277c86082a9c4c51aa4f2bd35e25d875', 'request_id': 'req-91cf8918-097b-4b8e-8ff5-096ea0188540'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:22.544461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '277c86082a9c4c51aa4f2bd35e25d875', 'request_id': 'req-91cf8918-097b-4b8e-8ff5-096ea0188540'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:22.675707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] The token cache is being invalidate because project 277c86082a9c4c51aa4f2bd35e25d875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:22.675961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:22.677021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-91cf8918-097b-4b8e-8ff5-096ea0188540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:22.679103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1168/2337] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:50:22 2022] DELETE /identity/v3/projects/277c86082a9c4c51aa4f2bd35e25d875 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:22.684836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ad54a-bdca-4f81-bfc0-eb85326a91af None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:22.687789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ad54a-bdca-4f81-bfc0-eb85326a91af None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:22.687789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ad54a-bdca-4f81-bfc0-eb85326a91af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:22.709585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ed4ad54a-bdca-4f81-bfc0-eb85326a91af None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:22.710903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ed4ad54a-bdca-4f81-bfc0-eb85326a91af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:22.815230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1170/2338] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:22.823800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6b42-6611-4188-b9ec-cda5856e94c9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:22.824110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6b42-6611-4188-b9ec-cda5856e94c9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:22.824395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f6b42-6611-4188-b9ec-cda5856e94c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:22.866628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-775f6b42-6611-4188-b9ec-cda5856e94c9 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:22.868054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-775f6b42-6611-4188-b9ec-cda5856e94c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:22.881960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1169/2339] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:22.886554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ad54a-bdca-4f81-bfc0-eb85326a91af None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:22.900194 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ad54a-bdca-4f81-bfc0-eb85326a91af None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:22.906275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:22.907083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:22.907373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:22.907648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:22.908591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:50:22.909006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:22.910694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:22.925435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1171/2340] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:50:22.930258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6b42-6611-4188-b9ec-cda5856e94c9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:22.939240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f6b42-6611-4188-b9ec-cda5856e94c9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:22.945102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaa61a-7e77-42e1-93a8-287a500e5c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:22.945772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaa61a-7e77-42e1-93a8-287a500e5c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:22.946053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaa61a-7e77-42e1-93a8-287a500e5c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:22.946328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcaa61a-7e77-42e1-93a8-287a500e5c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:22.947081 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaa61a-7e77-42e1-93a8-287a500e5c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:22.949330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcaa61a-7e77-42e1-93a8-287a500e5c85 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:23.055356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1170/2341] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:50:22 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:23.056586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:23.067274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106606db-5c06-4bf8-9b89-c6cd458129b9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:23.140120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaf171-467a-4c34-95f9-5d21a6265e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:23.140514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf171-467a-4c34-95f9-5d21a6265e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:23.140801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf171-467a-4c34-95f9-5d21a6265e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:23.141162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf171-467a-4c34-95f9-5d21a6265e77 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:23.141778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaf171-467a-4c34-95f9-5d21a6265e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:23.144360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaf171-467a-4c34-95f9-5d21a6265e77 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:23.175752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:23.276658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1172/2342] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:50:23 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:50:23.278588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaa61a-7e77-42e1-93a8-287a500e5c85 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:23.293598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcaa61a-7e77-42e1-93a8-287a500e5c85 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:23.298290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:23.302669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2634-7145-4ff3-98b4-4fc6bf76042e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:23.303459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2634-7145-4ff3-98b4-4fc6bf76042e admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:23.303825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2634-7145-4ff3-98b4-4fc6bf76042e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:23.304202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb2634-7145-4ff3-98b4-4fc6bf76042e admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:23.305117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2634-7145-4ff3-98b4-4fc6bf76042e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:23.306841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb2634-7145-4ff3-98b4-4fc6bf76042e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:23.318949 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1171/2343] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:23.326646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaf171-467a-4c34-95f9-5d21a6265e77 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:23.338002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaf171-467a-4c34-95f9-5d21a6265e77 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:23.345630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d39633-e3b3-4bd9-b362-fb167c6a5267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:23.346498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39633-e3b3-4bd9-b362-fb167c6a5267 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:23.347038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39633-e3b3-4bd9-b362-fb167c6a5267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:23.347323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d39633-e3b3-4bd9-b362-fb167c6a5267 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:23.348064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d39633-e3b3-4bd9-b362-fb167c6a5267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:23.349800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d39633-e3b3-4bd9-b362-fb167c6a5267 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:23.364335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1173/2344] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:23.369582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2634-7145-4ff3-98b4-4fc6bf76042e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:23.380657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb2634-7145-4ff3-98b4-4fc6bf76042e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:23.385242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:23.391073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:23.391073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:23.391073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] PATH_INFO: `/v3/projects/88023ebb8f4041e9a3d621eb52a599c8/users/c09f79875f1543c49212458b6aec29dc/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:23.402265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88023ebb8f4041e9a3d621eb52a599c8, user_id=c09f79875f1543c49212458b6aec29dc, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:23.404985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:23.480302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1172/2345] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:23 2022] PUT /identity/v3/projects/88023ebb8f4041e9a3d621eb52a599c8/users/c09f79875f1543c49212458b6aec29dc/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:23.492184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce04a09-1358-48e5-b6ac-644329606b7f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:23.492495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce04a09-1358-48e5-b6ac-644329606b7f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:23.492749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce04a09-1358-48e5-b6ac-644329606b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:23.532931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-2ce04a09-1358-48e5-b6ac-644329606b7f None None] MFA Rules not processed for user `c09f79875f1543c49212458b6aec29dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:23.535167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2ce04a09-1358-48e5-b6ac-644329606b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:23.632961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1174/2346] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:23.645166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:23.646940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:23.722421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac7815-fba4-43e7-acb7-1e7db7976df3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:23.727747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70258c-c02f-41af-ae27-804e019ae707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:23.728422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70258c-c02f-41af-ae27-804e019ae707 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:23.728708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70258c-c02f-41af-ae27-804e019ae707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:23.728989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70258c-c02f-41af-ae27-804e019ae707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:23.740106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70258c-c02f-41af-ae27-804e019ae707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:23.741880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70258c-c02f-41af-ae27-804e019ae707 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:23.751446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1173/2347] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:23.771220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce04a09-1358-48e5-b6ac-644329606b7f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:23.844725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce04a09-1358-48e5-b6ac-644329606b7f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:23.850884 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:23.852121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:23.852605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:23.852883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] PATH_INFO: `/v3/users/c09f79875f1543c49212458b6aec29dc` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:23.854348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=c09f79875f1543c49212458b6aec29dc)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:23.856432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:24.137116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c09f79875f1543c49212458b6aec29dc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:24.137928 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c09f79875f1543c49212458b6aec29dc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:24.146711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c09f79875f1543c49212458b6aec29dc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:24.172077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c09f79875f1543c49212458b6aec29dc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:24.173548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c09f79875f1543c49212458b6aec29dc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:24.270564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1175/2348] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:50:23 2022] DELETE /identity/v3/users/c09f79875f1543c49212458b6aec29dc => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:24.275033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b46d-cbac-4a67-959a-47932cf5c4a4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:24.275520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b46d-cbac-4a67-959a-47932cf5c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:24.275520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b46d-cbac-4a67-959a-47932cf5c4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:24.295166 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d3e6b46d-cbac-4a67-959a-47932cf5c4a4 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:24.296892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d3e6b46d-cbac-4a67-959a-47932cf5c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:24.339156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:24.370582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1174/2349] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:24.379378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:24.381293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:24.462466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde42e9-8520-4e40-a7bf-7335dee7a7ad admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:24.466474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a6f97-a09a-4db4-bf5a-c1217484bfbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:24.466819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6f97-a09a-4db4-bf5a-c1217484bfbe service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:24.467098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6f97-a09a-4db4-bf5a-c1217484bfbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:24.467372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a6f97-a09a-4db4-bf5a-c1217484bfbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:24.478162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6f97-a09a-4db4-bf5a-c1217484bfbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:24.479646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a6f97-a09a-4db4-bf5a-c1217484bfbe service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:24.498591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1176/2350] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:25.057931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6b46d-cbac-4a67-959a-47932cf5c4a4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:25.059988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d3e6b46d-cbac-4a67-959a-47932cf5c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:25.081613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:25.084364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6b46d-cbac-4a67-959a-47932cf5c4a4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:25.089731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:25.090655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:25.096613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:25.096613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] PATH_INFO: `/v3/projects/88023ebb8f4041e9a3d621eb52a599c8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:25.096613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88023ebb8f4041e9a3d621eb52a599c8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:25.096613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:25.249433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88023ebb8f4041e9a3d621eb52a599c8', 'request_id': 'req-51f65977-1f87-4278-8b12-fecb634af960'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:25.283678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88023ebb8f4041e9a3d621eb52a599c8', 'request_id': 'req-51f65977-1f87-4278-8b12-fecb634af960'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:25.294287 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88023ebb8f4041e9a3d621eb52a599c8', 'request_id': 'req-51f65977-1f87-4278-8b12-fecb634af960'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:25.412756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] The token cache is being invalidate because project 88023ebb8f4041e9a3d621eb52a599c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:25.413288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:25.419252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-51f65977-1f87-4278-8b12-fecb634af960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:25.422685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1175/2351] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:50:25 2022] DELETE /identity/v3/projects/88023ebb8f4041e9a3d621eb52a599c8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:25.425197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d9cf4-1f02-4797-8118-d8527171fbc2 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:25.426103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d9cf4-1f02-4797-8118-d8527171fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:25.426616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d9cf4-1f02-4797-8118-d8527171fbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:25.467452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b89d9cf4-1f02-4797-8118-d8527171fbc2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:25.468706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b89d9cf4-1f02-4797-8118-d8527171fbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:25.624427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1177/2352] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:25.634087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec40b6-807d-43da-a396-1d96fb6319a1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:25.634420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec40b6-807d-43da-a396-1d96fb6319a1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:25.634959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec40b6-807d-43da-a396-1d96fb6319a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:25.671551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-d7ec40b6-807d-43da-a396-1d96fb6319a1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:25.677293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7ec40b6-807d-43da-a396-1d96fb6319a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:25.693626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1176/2353] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:25.698119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d9cf4-1f02-4797-8118-d8527171fbc2 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:25.713016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d9cf4-1f02-4797-8118-d8527171fbc2 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:25.719935 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:25.721869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:25.722963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:25.723743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:25.724739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:50:25.725248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:25.727133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:25.759047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec40b6-807d-43da-a396-1d96fb6319a1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:25.764014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1178/2354] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:50:25.769904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ec40b6-807d-43da-a396-1d96fb6319a1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:25.777969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d01cd-5d08-42cb-89a0-dd56278fec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:25.779127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d01cd-5d08-42cb-89a0-dd56278fec04 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:25.779875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d01cd-5d08-42cb-89a0-dd56278fec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:25.780237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d01cd-5d08-42cb-89a0-dd56278fec04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:25.781067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d01cd-5d08-42cb-89a0-dd56278fec04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:25.783938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d01cd-5d08-42cb-89a0-dd56278fec04 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:25.964900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1177/2355] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:50:25 2022] POST /identity/v3/projects => generated 385 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:25.969248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:25.981246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce8fc2-6b98-454f-be66-46df5cb4b0f8 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:26.109656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24783ab-96b1-49a4-9c3c-8f6eb2532055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:26.110473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24783ab-96b1-49a4-9c3c-8f6eb2532055 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:26.111618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24783ab-96b1-49a4-9c3c-8f6eb2532055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:26.112073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24783ab-96b1-49a4-9c3c-8f6eb2532055 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:26.113208 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24783ab-96b1-49a4-9c3c-8f6eb2532055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:26.116733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24783ab-96b1-49a4-9c3c-8f6eb2532055 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:26.256331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1179/2356] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:50:25 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:50:26.257187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d01cd-5d08-42cb-89a0-dd56278fec04 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:26.279361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d01cd-5d08-42cb-89a0-dd56278fec04 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:26.288142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec979c-7822-4ba7-89d0-3e3e362a373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:26.289467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec979c-7822-4ba7-89d0-3e3e362a373e admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:26.290724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec979c-7822-4ba7-89d0-3e3e362a373e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:26.291333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec979c-7822-4ba7-89d0-3e3e362a373e admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:26.292377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec979c-7822-4ba7-89d0-3e3e362a373e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:26.294043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec979c-7822-4ba7-89d0-3e3e362a373e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:26.310012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1178/2357] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:50:26.311277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24783ab-96b1-49a4-9c3c-8f6eb2532055 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:26.324121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24783ab-96b1-49a4-9c3c-8f6eb2532055 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:26.332193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593f0f6-a3ab-47a2-9040-b1b802e04d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:26.332882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f0f6-a3ab-47a2-9040-b1b802e04d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:26.333173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f0f6-a3ab-47a2-9040-b1b802e04d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:26.333430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593f0f6-a3ab-47a2-9040-b1b802e04d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:26.334178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593f0f6-a3ab-47a2-9040-b1b802e04d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:26.335963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593f0f6-a3ab-47a2-9040-b1b802e04d07 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:26.348922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1180/2358] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:26.353220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec979c-7822-4ba7-89d0-3e3e362a373e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:26.366689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec979c-7822-4ba7-89d0-3e3e362a373e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:26.371410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:26.372356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:26.372639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:26.372918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] PATH_INFO: `/v3/projects/1f209f1ef52248f39150222092397999/users/ce7be17f35f14da1bc9770fd03829f3b/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:26.390310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f209f1ef52248f39150222092397999, user_id=ce7be17f35f14da1bc9770fd03829f3b, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:26.393321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:26.488814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1179/2359] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:26 2022] PUT /identity/v3/projects/1f209f1ef52248f39150222092397999/users/ce7be17f35f14da1bc9770fd03829f3b/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:26.492251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0379dfd-94ea-467f-be5d-95aac870a177 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:26.493124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0379dfd-94ea-467f-be5d-95aac870a177 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:26.493609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0379dfd-94ea-467f-be5d-95aac870a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:26.500141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:26.543772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-a0379dfd-94ea-467f-be5d-95aac870a177 None None] MFA Rules not processed for user `ce7be17f35f14da1bc9770fd03829f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:26.545274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a0379dfd-94ea-467f-be5d-95aac870a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:26.620639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1181/2360] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:26.637988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:26.644566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:26.733619 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1ff7d-4d82-4602-8326-98d7ab2327f8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:26.739308 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:26.740088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:26.740375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:26.740651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:26.756741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:26.771549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:26.785045 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1180/2361] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:26.983343 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:30.097039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58003-6469-4e8c-8c48-11afbbb5d910 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:30.097708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58003-6469-4e8c-8c48-11afbbb5d910 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:30.104751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f58003-6469-4e8c-8c48-11afbbb5d910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:30.131116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-81f58003-6469-4e8c-8c48-11afbbb5d910 None None] MFA Rules not processed for user `fa3ce802f8d44bfd9232dcc4879fcacf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:30.132367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-81f58003-6469-4e8c-8c48-11afbbb5d910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:30.228506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1182/2362] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:30.247646 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:30.249091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:30.340200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2939af1-ec4f-4256-91e2-920c54a9a9fd service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:30.343898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:30.344759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:30.345265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:30.345567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:30.347421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:30.419015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:30.420458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:30.430581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1181/2363] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:50:30.702953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f5df-1d96-4907-bc84-a0f88b4661bc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:30.703285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f5df-1d96-4907-bc84-a0f88b4661bc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:30.703608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8f5df-1d96-4907-bc84-a0f88b4661bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:30.778141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-acc8f5df-1d96-4907-bc84-a0f88b4661bc None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:30.779874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-acc8f5df-1d96-4907-bc84-a0f88b4661bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:30.851044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:30.888874 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1183/2364] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:30.948765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:30.950337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:31.026250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:31.059128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01168cb-a922-451b-84b6-f29e69d539f8 service glance] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:31.065453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021627a7-7704-4e1e-a38c-9a3ac04106f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:31.069207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021627a7-7704-4e1e-a38c-9a3ac04106f8 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:31.069207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021627a7-7704-4e1e-a38c-9a3ac04106f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:31.069207 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021627a7-7704-4e1e-a38c-9a3ac04106f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:31.079172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021627a7-7704-4e1e-a38c-9a3ac04106f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:31.081778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021627a7-7704-4e1e-a38c-9a3ac04106f8 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:31.092100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1182/2365] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:50:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:50:33.560736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c209-e128-437e-9e43-939647a6f67b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:33.561794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c209-e128-437e-9e43-939647a6f67b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:33.562307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7c209-e128-437e-9e43-939647a6f67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:33.596480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-a9f7c209-e128-437e-9e43-939647a6f67b None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:33.598176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a9f7c209-e128-437e-9e43-939647a6f67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:33.624482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1184/2366] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:50:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:33.648653 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021627a7-7704-4e1e-a38c-9a3ac04106f8 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:33.666489 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021627a7-7704-4e1e-a38c-9a3ac04106f8 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:33.675259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e782c-fbd2-4dfe-8715-0b229f66c649 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:33.691329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e782c-fbd2-4dfe-8715-0b229f66c649 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:33.691329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e782c-fbd2-4dfe-8715-0b229f66c649 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:33.691329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e782c-fbd2-4dfe-8715-0b229f66c649 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:33.708769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e782c-fbd2-4dfe-8715-0b229f66c649 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:33.711164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e782c-fbd2-4dfe-8715-0b229f66c649 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:33.759810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1183/2367] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:50:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:50:35.214855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e061e-dcaa-489c-a776-b7152effff09 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:35.219399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e061e-dcaa-489c-a776-b7152effff09 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:35.219399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e061e-dcaa-489c-a776-b7152effff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:35.236619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-6c8e061e-dcaa-489c-a776-b7152effff09 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:35.238305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6c8e061e-dcaa-489c-a776-b7152effff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:35.274396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1185/2368] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 26 12:50:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:35.294788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e782c-fbd2-4dfe-8715-0b229f66c649 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:35.308322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e782c-fbd2-4dfe-8715-0b229f66c649 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:35.316346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d9d9-9ccb-4dee-bf48-9f65236771fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:35.317367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d9d9-9ccb-4dee-bf48-9f65236771fe service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:35.317483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d9d9-9ccb-4dee-bf48-9f65236771fe service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:35.317730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8d9d9-9ccb-4dee-bf48-9f65236771fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:35.327396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8d9d9-9ccb-4dee-bf48-9f65236771fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:35.329737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd8d9d9-9ccb-4dee-bf48-9f65236771fe service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:35.340105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1184/2369] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:50:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:50:36.421806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633091a-cd3e-441d-b105-c332cb3412a5 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:36.422862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633091a-cd3e-441d-b105-c332cb3412a5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:36.423313 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633091a-cd3e-441d-b105-c332cb3412a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:36.446503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9633091a-cd3e-441d-b105-c332cb3412a5 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:36.447778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9633091a-cd3e-441d-b105-c332cb3412a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:36.456264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1186/2370] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:50:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:36.472989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d9d9-9ccb-4dee-bf48-9f65236771fe service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:36.484864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8d9d9-9ccb-4dee-bf48-9f65236771fe service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:36.493544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af7a7f-1538-4b4e-9601-3de128ad1a16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:36.494632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7a7f-1538-4b4e-9601-3de128ad1a16 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:36.495092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7a7f-1538-4b4e-9601-3de128ad1a16 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:36.495363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af7a7f-1538-4b4e-9601-3de128ad1a16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:36.505584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af7a7f-1538-4b4e-9601-3de128ad1a16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:36.507402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20af7a7f-1538-4b4e-9601-3de128ad1a16 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:36.516616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1185/2371] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:50:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:50:37.266467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd874-629e-42ed-8673-1372417c8bbc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:37.266600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd874-629e-42ed-8673-1372417c8bbc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:37.266816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd874-629e-42ed-8673-1372417c8bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:37.291659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-6b6bd874-629e-42ed-8673-1372417c8bbc None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:37.292888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6b6bd874-629e-42ed-8673-1372417c8bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:37.301475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1187/2372] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 26 12:50:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:37.318799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af7a7f-1538-4b4e-9601-3de128ad1a16 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:37.345239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20af7a7f-1538-4b4e-9601-3de128ad1a16 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:37.350674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:37.351532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:37.351992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:37.352420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:37.363822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:37.365723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:37.376727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1186/2373] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:50:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:50:40.531945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd874-629e-42ed-8673-1372417c8bbc None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:40.534246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6b6bd874-629e-42ed-8673-1372417c8bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:40.692038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd874-629e-42ed-8673-1372417c8bbc None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:40.698546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a3766-2f03-471d-ae9b-a9e2948fdb3c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:40.699380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a3766-2f03-471d-ae9b-a9e2948fdb3c service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:40.699667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a3766-2f03-471d-ae9b-a9e2948fdb3c service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:40.699944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a3766-2f03-471d-ae9b-a9e2948fdb3c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:40.701887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-221a3766-2f03-471d-ae9b-a9e2948fdb3c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:40.714761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a3766-2f03-471d-ae9b-a9e2948fdb3c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:40.716409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221a3766-2f03-471d-ae9b-a9e2948fdb3c service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:40.728238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1188/2374] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:41.857666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:41.860057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:42.004618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbd7d0-b7fa-46b3-9c1c-12b437411055 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:42.004618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:42.004618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:42.004618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:42.005152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] PATH_INFO: `/v3/users/b760cb7932fc4b3ea0d3e7526f15be0c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:42.005152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b760cb7932fc4b3ea0d3e7526f15be0c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:42.005152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:43.032333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b760cb7932fc4b3ea0d3e7526f15be0c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:43.033043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b760cb7932fc4b3ea0d3e7526f15be0c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:43.033676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b760cb7932fc4b3ea0d3e7526f15be0c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:43.050719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b760cb7932fc4b3ea0d3e7526f15be0c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:43.058855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b760cb7932fc4b3ea0d3e7526f15be0c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:43.065007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:43.182766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1187/2375] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:50:41 2022] DELETE /identity/v3/users/b760cb7932fc4b3ea0d3e7526f15be0c => generated 0 bytes in 1323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:43.184508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7458e0-63c5-42b7-9928-78f7eed557c4 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:43.185007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7458e0-63c5-42b7-9928-78f7eed557c4 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:43.185096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7458e0-63c5-42b7-9928-78f7eed557c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:43.205497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ba7458e0-63c5-42b7-9928-78f7eed557c4 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:43.206838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ba7458e0-63c5-42b7-9928-78f7eed557c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:43.289460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1189/2376] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:43.315504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:43.315504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:43.377360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d313efae-811d-48ee-9048-a0a9f82f3d23 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:43.380927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a2af4-c01b-493a-994f-0dc0c8f979b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:43.381570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2af4-c01b-493a-994f-0dc0c8f979b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:43.381846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2af4-c01b-493a-994f-0dc0c8f979b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:43.382118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a2af4-c01b-493a-994f-0dc0c8f979b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:43.391211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a2af4-c01b-493a-994f-0dc0c8f979b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:43.392618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a2af4-c01b-493a-994f-0dc0c8f979b9 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:43.402298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1188/2377] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:50:43.730356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7458e0-63c5-42b7-9928-78f7eed557c4 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:43.731825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ba7458e0-63c5-42b7-9928-78f7eed557c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:43.744922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7458e0-63c5-42b7-9928-78f7eed557c4 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:43.749902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:43.751125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:43.751468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:43.751633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] PATH_INFO: `/v3/projects/a4ab83dbdfb7409bbea3af2745c1ddaf` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:43.752887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4ab83dbdfb7409bbea3af2745c1ddaf)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:43.754717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:43.779880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:43.894618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'request_id': 'req-cabc32a7-72e4-4e19-9984-580d80f4808c'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:43.900542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'request_id': 'req-cabc32a7-72e4-4e19-9984-580d80f4808c'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:44.071264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4ab83dbdfb7409bbea3af2745c1ddaf', 'request_id': 'req-cabc32a7-72e4-4e19-9984-580d80f4808c'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:44.084974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] The token cache is being invalidate because project a4ab83dbdfb7409bbea3af2745c1ddaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:44.085259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:44.085905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-cabc32a7-72e4-4e19-9984-580d80f4808c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:44.087579 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1190/2378] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:50:43 2022] DELETE /identity/v3/projects/a4ab83dbdfb7409bbea3af2745c1ddaf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:44.094073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64415cd-8ef5-4aaa-b910-30d6ddc3a7f5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.094601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64415cd-8ef5-4aaa-b910-30d6ddc3a7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.094708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64415cd-8ef5-4aaa-b910-30d6ddc3a7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.114097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a64415cd-8ef5-4aaa-b910-30d6ddc3a7f5 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:44.115506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a64415cd-8ef5-4aaa-b910-30d6ddc3a7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:44.177343 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1189/2379] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:44.185090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8c248-f71c-4803-8ac2-9599e42113b4 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.185612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8c248-f71c-4803-8ac2-9599e42113b4 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.186013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8c248-f71c-4803-8ac2-9599e42113b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.195800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eff2d6-f3a0-4a7d-bfcc-7b996ed8fee9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.196186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eff2d6-f3a0-4a7d-bfcc-7b996ed8fee9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.196474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eff2d6-f3a0-4a7d-bfcc-7b996ed8fee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.206791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-98e8c248-f71c-4803-8ac2-9599e42113b4 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:44.208029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-98e8c248-f71c-4803-8ac2-9599e42113b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:44.220009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1191/2380] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:44.221220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-56eff2d6-f3a0-4a7d-bfcc-7b996ed8fee9 None None] MFA Rules not processed for user `db52c21a4c58422fa7ccad6232fc8f21`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:44.222514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-56eff2d6-f3a0-4a7d-bfcc-7b996ed8fee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:44.226781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8c248-f71c-4803-8ac2-9599e42113b4 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:44.237773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8c248-f71c-4803-8ac2-9599e42113b4 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:44.242915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:44.243812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.244160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.244658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.245488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:50:44.245865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:44.248765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:44.278999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1192/2381] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:50:44.293516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:44.296867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbae3c12-c022-44c8-82c2-1842b32380e6 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:44.301670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49150153-47fd-40d1-bf8b-6aefe1ecd62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:44.302366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150153-47fd-40d1-bf8b-6aefe1ecd62d admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.302694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150153-47fd-40d1-bf8b-6aefe1ecd62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.302977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49150153-47fd-40d1-bf8b-6aefe1ecd62d admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.303670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49150153-47fd-40d1-bf8b-6aefe1ecd62d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:44.304629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1190/2382] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:44.305566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49150153-47fd-40d1-bf8b-6aefe1ecd62d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:44.456421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1193/2383] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:50:44 2022] POST /identity/v3/projects => generated 391 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:44.460549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eff2d6-f3a0-4a7d-bfcc-7b996ed8fee9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:44.472280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eff2d6-f3a0-4a7d-bfcc-7b996ed8fee9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:44.520453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:44.534120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac293ed-6b7c-449b-ae13-f3dbc847db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:44.535363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac293ed-6b7c-449b-ae13-f3dbc847db9b admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.535363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac293ed-6b7c-449b-ae13-f3dbc847db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.535363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac293ed-6b7c-449b-ae13-f3dbc847db9b admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.536082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac293ed-6b7c-449b-ae13-f3dbc847db9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:44.538160 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac293ed-6b7c-449b-ae13-f3dbc847db9b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:44.659396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1191/2384] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:50:44 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:50:44.664149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49150153-47fd-40d1-bf8b-6aefe1ecd62d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:44.675167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49150153-47fd-40d1-bf8b-6aefe1ecd62d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:44.679892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786217a-f136-4458-a0e4-58546c4a63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:44.680664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786217a-f136-4458-a0e4-58546c4a63cb admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.680956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786217a-f136-4458-a0e4-58546c4a63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.681236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b786217a-f136-4458-a0e4-58546c4a63cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.681964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786217a-f136-4458-a0e4-58546c4a63cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:44.683594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b786217a-f136-4458-a0e4-58546c4a63cb admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:44.694900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1194/2385] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:44.698896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac293ed-6b7c-449b-ae13-f3dbc847db9b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:44.710047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac293ed-6b7c-449b-ae13-f3dbc847db9b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:44.714723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131bb4fd-6adc-4800-9033-c50de7d7a211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:44.715480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb4fd-6adc-4800-9033-c50de7d7a211 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.715766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb4fd-6adc-4800-9033-c50de7d7a211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.716041 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131bb4fd-6adc-4800-9033-c50de7d7a211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.716913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bb4fd-6adc-4800-9033-c50de7d7a211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:44.718948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131bb4fd-6adc-4800-9033-c50de7d7a211 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:44.730564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1192/2386] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:44.737944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786217a-f136-4458-a0e4-58546c4a63cb admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:44.745561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b786217a-f136-4458-a0e4-58546c4a63cb admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:44.750966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:44.751872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.752159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.752432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] PATH_INFO: `/v3/projects/f096d4228eb441ebb1154d592d50b408/users/42e601d8b5fe4f429e3b8a5ee1788e8d/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.769034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f096d4228eb441ebb1154d592d50b408, user_id=42e601d8b5fe4f429e3b8a5ee1788e8d, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:44.771907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:44.848436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1195/2387] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:44 2022] PUT /identity/v3/projects/f096d4228eb441ebb1154d592d50b408/users/42e601d8b5fe4f429e3b8a5ee1788e8d/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:44.859830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027e5d-fc9d-434d-8630-2496bfa7396e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:44.860120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027e5d-fc9d-434d-8630-2496bfa7396e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:44.860404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32027e5d-fc9d-434d-8630-2496bfa7396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:44.887926 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-32027e5d-fc9d-434d-8630-2496bfa7396e None None] MFA Rules not processed for user `42e601d8b5fe4f429e3b8a5ee1788e8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:44.889138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-32027e5d-fc9d-434d-8630-2496bfa7396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:44.975403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1193/2388] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:44.998730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:45.001346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:45.070817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1153fe-f624-461b-b679-7fa9ae89bf25 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:45.075438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf902f2-a992-4387-a5a5-2a90179def62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:45.076407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf902f2-a992-4387-a5a5-2a90179def62 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:45.078693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf902f2-a992-4387-a5a5-2a90179def62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:45.079031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf902f2-a992-4387-a5a5-2a90179def62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:45.088382 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf902f2-a992-4387-a5a5-2a90179def62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:45.089857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf902f2-a992-4387-a5a5-2a90179def62 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:45.099308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1196/2389] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:45.131802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027e5d-fc9d-434d-8630-2496bfa7396e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:45.133240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-32027e5d-fc9d-434d-8630-2496bfa7396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:45.202620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32027e5d-fc9d-434d-8630-2496bfa7396e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:45.207591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:45.208572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:45.208934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:45.209276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] PATH_INFO: `/v3/users/ce7be17f35f14da1bc9770fd03829f3b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:45.210567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7be17f35f14da1bc9770fd03829f3b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:45.212702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:45.567104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7be17f35f14da1bc9770fd03829f3b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:45.568200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7be17f35f14da1bc9770fd03829f3b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:45.569127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7be17f35f14da1bc9770fd03829f3b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:45.574895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:45.583119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7be17f35f14da1bc9770fd03829f3b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:45.589908 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7be17f35f14da1bc9770fd03829f3b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:45.744991 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1194/2390] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:50:45 2022] DELETE /identity/v3/users/ce7be17f35f14da1bc9770fd03829f3b => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:45.749769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71b7fe-4c07-423d-8d8f-4655ec2e6d28 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:45.751013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71b7fe-4c07-423d-8d8f-4655ec2e6d28 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:45.751013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71b7fe-4c07-423d-8d8f-4655ec2e6d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:45.768045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ff71b7fe-4c07-423d-8d8f-4655ec2e6d28 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:45.769250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ff71b7fe-4c07-423d-8d8f-4655ec2e6d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:45.798859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:45.828905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1197/2391] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:45.838676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:45.840099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:45.899624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d440ae5-2629-4dcf-b870-f6aa5da63655 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:45.903522 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:45.904299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:45.904585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:45.904851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:45.914237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:45.915694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:45.925316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1195/2392] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:46.382272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71b7fe-4c07-423d-8d8f-4655ec2e6d28 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:46.383805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ff71b7fe-4c07-423d-8d8f-4655ec2e6d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:46.396374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71b7fe-4c07-423d-8d8f-4655ec2e6d28 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:46.406415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:46.407327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:46.407608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:46.407879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] PATH_INFO: `/v3/projects/1f209f1ef52248f39150222092397999` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:46.409074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f209f1ef52248f39150222092397999)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:46.411093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:46.616356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f209f1ef52248f39150222092397999', 'request_id': 'req-22b279d6-5ee9-415a-bcd6-fad3854e73b4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:46.623905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f209f1ef52248f39150222092397999', 'request_id': 'req-22b279d6-5ee9-415a-bcd6-fad3854e73b4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:46.691673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:46.694126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:46.706932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1ff26-9af2-4d02-9fad-f4a6ce0c9497 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:46.744734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f209f1ef52248f39150222092397999', 'request_id': 'req-22b279d6-5ee9-415a-bcd6-fad3854e73b4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:46.757825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] The token cache is being invalidate because project 1f209f1ef52248f39150222092397999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:46.764996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:46.764996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-22b279d6-5ee9-415a-bcd6-fad3854e73b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:46.764996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1198/2393] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:50:46 2022] DELETE /identity/v3/projects/1f209f1ef52248f39150222092397999 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:46.765362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07431d-62a7-49f0-91e0-aca607f23e99 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:46.765362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07431d-62a7-49f0-91e0-aca607f23e99 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:46.765570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba07431d-62a7-49f0-91e0-aca607f23e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:46.766503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:46.767415 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:46.767694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:46.767964 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] PATH_INFO: `/v3/users/e3881a401b654b79b5b220d3ff65a81e` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:46.769186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3881a401b654b79b5b220d3ff65a81e)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:46.771076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:46.785353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ba07431d-62a7-49f0-91e0-aca607f23e99 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:46.786605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ba07431d-62a7-49f0-91e0-aca607f23e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:46.795795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1199/2394] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:46.803286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8cdd-f7f9-49ea-91be-e57bea93169c None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:46.803574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8cdd-f7f9-49ea-91be-e57bea93169c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:46.803859 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd8cdd-f7f9-49ea-91be-e57bea93169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:46.821805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-40fd8cdd-f7f9-49ea-91be-e57bea93169c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:46.833854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-40fd8cdd-f7f9-49ea-91be-e57bea93169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:46.833854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1200/2395] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:46.836443 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd8cdd-f7f9-49ea-91be-e57bea93169c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:46.845899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd8cdd-f7f9-49ea-91be-e57bea93169c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:46.850622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:46.851262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:46.851546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:46.851868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:46.852551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:50:46.852855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:46.854436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:46.866813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1201/2396] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:50:46.870928 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:46.880835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9f12f-6ba6-4e1e-92a5-71df53f10a30 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:46.885320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d76b9-216a-4ee0-8a42-04696cb8e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:46.885945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d76b9-216a-4ee0-8a42-04696cb8e380 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:46.886223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d76b9-216a-4ee0-8a42-04696cb8e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:46.886492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d76b9-216a-4ee0-8a42-04696cb8e380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:46.887188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d76b9-216a-4ee0-8a42-04696cb8e380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:46.889124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d76b9-216a-4ee0-8a42-04696cb8e380 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:47.017211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1202/2397] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:50:46 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:50:47.018373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d76b9-216a-4ee0-8a42-04696cb8e380 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:47.021787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3881a401b654b79b5b220d3ff65a81e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:47.022423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3881a401b654b79b5b220d3ff65a81e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:47.023042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3881a401b654b79b5b220d3ff65a81e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:47.037142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3881a401b654b79b5b220d3ff65a81e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:47.046512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-69445431-ef77-43a5-bab8-10aaada5beec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3881a401b654b79b5b220d3ff65a81e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:47.051358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:47.094802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d76b9-216a-4ee0-8a42-04696cb8e380 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:47.099569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:47.100244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.100553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.100831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.101526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:47.103499 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:47.171718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1196/2398] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:50:46 2022] DELETE /identity/v3/users/e3881a401b654b79b5b220d3ff65a81e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:50:47.176165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5920dcb-6a28-41c4-837c-1add058396d3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.176459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5920dcb-6a28-41c4-837c-1add058396d3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.176743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5920dcb-6a28-41c4-837c-1add058396d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.195328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f5920dcb-6a28-41c4-837c-1add058396d3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:47.196566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f5920dcb-6a28-41c4-837c-1add058396d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:47.211690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:47.216264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1203/2399] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:50:47 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:50:47.220190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:47.221811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:47.235343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18bff5-fe24-496c-90e0-819eec97acfa admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:47.262252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1197/2400] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:47.272613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5920dcb-6a28-41c4-837c-1add058396d3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:47.273984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f5920dcb-6a28-41c4-837c-1add058396d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:47.311191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826c3b-c54e-484d-b66c-aee330bf99bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:47.311916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826c3b-c54e-484d-b66c-aee330bf99bd admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.312196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826c3b-c54e-484d-b66c-aee330bf99bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.312468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56826c3b-c54e-484d-b66c-aee330bf99bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.313217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56826c3b-c54e-484d-b66c-aee330bf99bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:47.314938 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56826c3b-c54e-484d-b66c-aee330bf99bd admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:47.325128 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1204/2401] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:50:47.329948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826c3b-c54e-484d-b66c-aee330bf99bd admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:47.340200 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56826c3b-c54e-484d-b66c-aee330bf99bd admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:47.346186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5a8e-efae-4f3b-ad6f-b538710ab5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:47.346892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5a8e-efae-4f3b-ad6f-b538710ab5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.347180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5a8e-efae-4f3b-ad6f-b538710ab5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.347456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ab5a8e-efae-4f3b-ad6f-b538710ab5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.348306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab5a8e-efae-4f3b-ad6f-b538710ab5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:47.349885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5920dcb-6a28-41c4-837c-1add058396d3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:47.350710 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ab5a8e-efae-4f3b-ad6f-b538710ab5fd admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:47.353770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e5b14-3859-4f42-a78a-073b0669ad59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:47.354541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5b14-3859-4f42-a78a-073b0669ad59 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.354914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5b14-3859-4f42-a78a-073b0669ad59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.355397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e5b14-3859-4f42-a78a-073b0669ad59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.366703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1205/2402] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:50:47.367151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e5b14-3859-4f42-a78a-073b0669ad59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:47.367791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5a8e-efae-4f3b-ad6f-b538710ab5fd admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:47.368707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e5b14-3859-4f42-a78a-073b0669ad59 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:47.378410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ab5a8e-efae-4f3b-ad6f-b538710ab5fd admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:47.380802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1198/2403] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:50:47.384735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:47.385474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.385752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.386022 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] PATH_INFO: `/v3/projects/b2c3cf0851794497aac57c9d2fbfc6da/users/b1933169d9a94afb9393d35f3a523c25/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.403518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c3cf0851794497aac57c9d2fbfc6da, user_id=b1933169d9a94afb9393d35f3a523c25, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:47.406699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:47.517603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1206/2404] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:47 2022] PUT /identity/v3/projects/b2c3cf0851794497aac57c9d2fbfc6da/users/b1933169d9a94afb9393d35f3a523c25/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:50:47.525122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a2ca8-5567-4053-81a0-7308e552a6c3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.525410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a2ca8-5567-4053-81a0-7308e552a6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.525687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a2ca8-5567-4053-81a0-7308e552a6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.543204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-345a2ca8-5567-4053-81a0-7308e552a6c3 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:47.545807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-345a2ca8-5567-4053-81a0-7308e552a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:47.607907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1199/2405] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:47.618292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:47.619949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:47.683140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755eec3-c714-4927-8e7e-adb3b1ad7d3e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:47.687628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc64a7-a58a-414e-8ed5-742e298d38ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:47.688292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc64a7-a58a-414e-8ed5-742e298d38ef service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.698478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc64a7-a58a-414e-8ed5-742e298d38ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.698478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc64a7-a58a-414e-8ed5-742e298d38ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.698867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc64a7-a58a-414e-8ed5-742e298d38ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:47.700165 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc64a7-a58a-414e-8ed5-742e298d38ef service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:47.711209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1207/2406] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:47.944979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a2ca8-5567-4053-81a0-7308e552a6c3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:47.944979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-345a2ca8-5567-4053-81a0-7308e552a6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:47.955682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a2ca8-5567-4053-81a0-7308e552a6c3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:47.970420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:47.972511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:47.972889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:47.973256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] PATH_INFO: `/v3/projects/9197f50b232b45e0b25f6a6b3df902f5` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:47.979529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9197f50b232b45e0b25f6a6b3df902f5)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:47.979529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:48.184171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9197f50b232b45e0b25f6a6b3df902f5', 'request_id': 'req-e9e68397-5272-4639-a9c3-efdad7b21209'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.193578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9197f50b232b45e0b25f6a6b3df902f5', 'request_id': 'req-e9e68397-5272-4639-a9c3-efdad7b21209'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.200493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9197f50b232b45e0b25f6a6b3df902f5', 'request_id': 'req-e9e68397-5272-4639-a9c3-efdad7b21209'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.317261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] The token cache is being invalidate because project 9197f50b232b45e0b25f6a6b3df902f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:48.324476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.324476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e9e68397-5272-4639-a9c3-efdad7b21209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:48.324476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1200/2407] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:50:47 2022] DELETE /identity/v3/projects/9197f50b232b45e0b25f6a6b3df902f5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:48.329054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c3b2-cb24-4dae-86b4-568f70a4dd58 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.329506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c3b2-cb24-4dae-86b4-568f70a4dd58 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.329599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e8c3b2-cb24-4dae-86b4-568f70a4dd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.348500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b9e8c3b2-cb24-4dae-86b4-568f70a4dd58 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:48.349688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b9e8c3b2-cb24-4dae-86b4-568f70a4dd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:48.413427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1208/2408] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:48.421785 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7d6b4-eace-4aec-9b1b-04a7cf91984c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.422065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7d6b4-eace-4aec-9b1b-04a7cf91984c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.422338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7d6b4-eace-4aec-9b1b-04a7cf91984c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.441039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a7e7d6b4-eace-4aec-9b1b-04a7cf91984c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:48.442198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a7e7d6b4-eace-4aec-9b1b-04a7cf91984c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:48.470959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1201/2409] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:48.479518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8c3b2-cb24-4dae-86b4-568f70a4dd58 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:48.486384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e8c3b2-cb24-4dae-86b4-568f70a4dd58 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:48.491374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:48.492105 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.492438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.492852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.493607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:50:48.493912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:48.496355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:48.511696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1209/2410] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:50:48.522227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7d6b4-eace-4aec-9b1b-04a7cf91984c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:48.533070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7d6b4-eace-4aec-9b1b-04a7cf91984c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:48.539105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c264478-de98-49e3-9823-7e785e7fb63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:48.541004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c264478-de98-49e3-9823-7e785e7fb63f admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.541004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c264478-de98-49e3-9823-7e785e7fb63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.541004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c264478-de98-49e3-9823-7e785e7fb63f admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.541546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c264478-de98-49e3-9823-7e785e7fb63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:48.543674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c264478-de98-49e3-9823-7e785e7fb63f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:48.705987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1202/2411] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:50:48 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:48.709991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:48.721331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f318e8-a7f7-4c4b-a2f7-5844dd6b6cb9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:48.728174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:48.790122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c75557-957c-47cd-bb6d-e942b9239be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:48.790955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75557-957c-47cd-bb6d-e942b9239be7 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.791233 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75557-957c-47cd-bb6d-e942b9239be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.791504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c75557-957c-47cd-bb6d-e942b9239be7 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.792193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c75557-957c-47cd-bb6d-e942b9239be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:48.795011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c75557-957c-47cd-bb6d-e942b9239be7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:48.920024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:48.928085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1210/2412] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:50:48 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:50:48.932261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c264478-de98-49e3-9823-7e785e7fb63f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:48.947648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c264478-de98-49e3-9823-7e785e7fb63f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:48.953149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c122cb-1d33-47f7-877e-ac5809ec6dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:48.953830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c122cb-1d33-47f7-877e-ac5809ec6dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.954113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c122cb-1d33-47f7-877e-ac5809ec6dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.954418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c122cb-1d33-47f7-877e-ac5809ec6dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.955181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c122cb-1d33-47f7-877e-ac5809ec6dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:48.956852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c122cb-1d33-47f7-877e-ac5809ec6dc1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:48.967517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1203/2413] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:48.971620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c75557-957c-47cd-bb6d-e942b9239be7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:48.981829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c75557-957c-47cd-bb6d-e942b9239be7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:48.986609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ebe57-9cc2-4fb3-a55e-0f2ee3817be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:48.992954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebe57-9cc2-4fb3-a55e-0f2ee3817be8 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:48.992954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebe57-9cc2-4fb3-a55e-0f2ee3817be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:48.992954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ebe57-9cc2-4fb3-a55e-0f2ee3817be8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:48.992954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ebe57-9cc2-4fb3-a55e-0f2ee3817be8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:48.992954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420ebe57-9cc2-4fb3-a55e-0f2ee3817be8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:49.002143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1211/2414] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:50:49.006548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c122cb-1d33-47f7-877e-ac5809ec6dc1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:49.023243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c122cb-1d33-47f7-877e-ac5809ec6dc1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:49.034798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eac4fa-1670-481d-823a-67617f23a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:49.035786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac4fa-1670-481d-823a-67617f23a1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.036071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac4fa-1670-481d-823a-67617f23a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.036341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eac4fa-1670-481d-823a-67617f23a1fb admin admin] PATH_INFO: `/v3/projects/1db7c77856ff4434aefc38318164da4c/users/a994d585e34d4f73bb493a6994a34bd6/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.061272 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac4fa-1670-481d-823a-67617f23a1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db7c77856ff4434aefc38318164da4c, user_id=a994d585e34d4f73bb493a6994a34bd6, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:49.064443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eac4fa-1670-481d-823a-67617f23a1fb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:49.196290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1204/2415] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:50:49 2022] PUT /identity/v3/projects/1db7c77856ff4434aefc38318164da4c/users/a994d585e34d4f73bb493a6994a34bd6/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:49.207239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f683-bc6f-488f-ba07-22ebcd03d2dc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.207667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f683-bc6f-488f-ba07-22ebcd03d2dc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.208267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c4f683-bc6f-488f-ba07-22ebcd03d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.235729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28892a87-92e2-4db6-8bf9-00e6303c03bc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.236015 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28892a87-92e2-4db6-8bf9-00e6303c03bc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.236294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28892a87-92e2-4db6-8bf9-00e6303c03bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.239779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-08c4f683-bc6f-488f-ba07-22ebcd03d2dc None None] MFA Rules not processed for user `a994d585e34d4f73bb493a6994a34bd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:49.241030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-08c4f683-bc6f-488f-ba07-22ebcd03d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:49.254886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-28892a87-92e2-4db6-8bf9-00e6303c03bc None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:49.256114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-28892a87-92e2-4db6-8bf9-00e6303c03bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:49.315419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1205/2416] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:49.318700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1212/2417] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:49.329486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28892a87-92e2-4db6-8bf9-00e6303c03bc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:49.333976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4f683-bc6f-488f-ba07-22ebcd03d2dc None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:49.334959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-28892a87-92e2-4db6-8bf9-00e6303c03bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:49.338229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-08c4f683-bc6f-488f-ba07-22ebcd03d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:49.411888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c4f683-bc6f-488f-ba07-22ebcd03d2dc None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:49.417234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8a211-59de-4017-8288-6c8b2ca4b509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:49.417949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a211-59de-4017-8288-6c8b2ca4b509 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.418294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a211-59de-4017-8288-6c8b2ca4b509 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.418651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b8a211-59de-4017-8288-6c8b2ca4b509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.428720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8a211-59de-4017-8288-6c8b2ca4b509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:49.430363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b8a211-59de-4017-8288-6c8b2ca4b509 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:49.454319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1213/2418] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:49.470416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8a211-59de-4017-8288-6c8b2ca4b509 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:49.558473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b8a211-59de-4017-8288-6c8b2ca4b509 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:49.569113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:49.569113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.569113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.569113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] PATH_INFO: `/v3/users/a994d585e34d4f73bb493a6994a34bd6` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.569482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a994d585e34d4f73bb493a6994a34bd6)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:49.570229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:49.581928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28892a87-92e2-4db6-8bf9-00e6303c03bc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:49.603957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81b6c9-5098-4d5a-8461-9f7a12fdf956 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:49.603957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b6c9-5098-4d5a-8461-9f7a12fdf956 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.603957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b6c9-5098-4d5a-8461-9f7a12fdf956 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.603957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b6c9-5098-4d5a-8461-9f7a12fdf956 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.620157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81b6c9-5098-4d5a-8461-9f7a12fdf956 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:49.624288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81b6c9-5098-4d5a-8461-9f7a12fdf956 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:49.635976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1206/2419] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:50:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:50:49.637355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b460a-7302-40eb-b299-873aeceb2b79 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.637839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b460a-7302-40eb-b299-873aeceb2b79 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.637839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b460a-7302-40eb-b299-873aeceb2b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.675533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-b54b460a-7302-40eb-b299-873aeceb2b79 None None] MFA Rules not processed for user `b1933169d9a94afb9393d35f3a523c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:49.680275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b54b460a-7302-40eb-b299-873aeceb2b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:49.749773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1207/2420] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:50:49.760386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b460a-7302-40eb-b299-873aeceb2b79 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:49.769566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b460a-7302-40eb-b299-873aeceb2b79 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:49.773483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0b860-2757-4cc2-8439-6f0f3d7b3ae5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:49.774120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b860-2757-4cc2-8439-6f0f3d7b3ae5 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:49.774398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b860-2757-4cc2-8439-6f0f3d7b3ae5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:49.774707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0b860-2757-4cc2-8439-6f0f3d7b3ae5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:49.784260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0b860-2757-4cc2-8439-6f0f3d7b3ae5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:49.787064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0b860-2757-4cc2-8439-6f0f3d7b3ae5 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:49.796880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1208/2421] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:50:49.937319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a994d585e34d4f73bb493a6994a34bd6'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.938907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a994d585e34d4f73bb493a6994a34bd6'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.961389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a994d585e34d4f73bb493a6994a34bd6'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.992164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a994d585e34d4f73bb493a6994a34bd6'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:49.993465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a994d585e34d4f73bb493a6994a34bd6'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:50.138327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1214/2422] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:50:49 2022] DELETE /identity/v3/users/a994d585e34d4f73bb493a6994a34bd6 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:50.143261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad459ef-43c3-4a41-82b7-04cf8d71336f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.143871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad459ef-43c3-4a41-82b7-04cf8d71336f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.143871 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad459ef-43c3-4a41-82b7-04cf8d71336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.178949 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-dad459ef-43c3-4a41-82b7-04cf8d71336f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:50.180223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dad459ef-43c3-4a41-82b7-04cf8d71336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:50.287247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1209/2423] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:50:50.287927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:50.289320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:50.369969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11395dfe-0639-44ba-adc9-036a256a8d8f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:50.374556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa3bc6-9d7d-4300-8dc0-ddb57f847123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:50.375244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3bc6-9d7d-4300-8dc0-ddb57f847123 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:50.375523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3bc6-9d7d-4300-8dc0-ddb57f847123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:50.375791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa3bc6-9d7d-4300-8dc0-ddb57f847123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:50.386172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa3bc6-9d7d-4300-8dc0-ddb57f847123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:50.388326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa3bc6-9d7d-4300-8dc0-ddb57f847123 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:50.399435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1215/2424] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:50:50.605611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:50.885970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:51.292724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad459ef-43c3-4a41-82b7-04cf8d71336f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:50:51.292724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dad459ef-43c3-4a41-82b7-04cf8d71336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:51.335832 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad459ef-43c3-4a41-82b7-04cf8d71336f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:50:51.346198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:50:51.347313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:51.347596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:51.355258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] PATH_INFO: `/v3/projects/1db7c77856ff4434aefc38318164da4c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:51.355258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db7c77856ff4434aefc38318164da4c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:50:51.355258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:50:51.572440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db7c77856ff4434aefc38318164da4c', 'request_id': 'req-e300ab0e-b1ee-410b-81df-cba18f1f269b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:51.578984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db7c77856ff4434aefc38318164da4c', 'request_id': 'req-e300ab0e-b1ee-410b-81df-cba18f1f269b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:51.584405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db7c77856ff4434aefc38318164da4c', 'request_id': 'req-e300ab0e-b1ee-410b-81df-cba18f1f269b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:51.662645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] The token cache is being invalidate because project 1db7c77856ff4434aefc38318164da4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:50:51.663278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:51.664133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:50:51.665972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1210/2425] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:50:51 2022] DELETE /identity/v3/projects/1db7c77856ff4434aefc38318164da4c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:50:52.372978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:59.298762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afd52-001d-413b-a518-32c3959f2d35 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:50:59.299369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afd52-001d-413b-a518-32c3959f2d35 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:50:59.299369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2afd52-001d-413b-a518-32c3959f2d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:50:59.319532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-8b2afd52-001d-413b-a518-32c3959f2d35 None None] MFA Rules not processed for user `b1933169d9a94afb9393d35f3a523c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:50:59.320937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8b2afd52-001d-413b-a518-32c3959f2d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:50:59.342108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:50:59.386999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1216/2426] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:50:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:02.685527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:09.714735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=15 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:20.432140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:20.433658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:20.497872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300ab0e-b1ee-410b-81df-cba18f1f269b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:20.502545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:20.503435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:20.503733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:20.503985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] PATH_INFO: `/v3/users/42e601d8b5fe4f429e3b8a5ee1788e8d` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:20.505173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=42e601d8b5fe4f429e3b8a5ee1788e8d)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:20.507125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:20.718043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42e601d8b5fe4f429e3b8a5ee1788e8d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:20.719011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42e601d8b5fe4f429e3b8a5ee1788e8d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:20.719621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42e601d8b5fe4f429e3b8a5ee1788e8d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:20.735631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42e601d8b5fe4f429e3b8a5ee1788e8d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:20.743006 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42e601d8b5fe4f429e3b8a5ee1788e8d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:20.872802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1211/2427] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:51:20 2022] DELETE /identity/v3/users/42e601d8b5fe4f429e3b8a5ee1788e8d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:51:20.877328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48256-284e-4e9d-85d8-60f877ce2d80 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:20.877916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48256-284e-4e9d-85d8-60f877ce2d80 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:20.877916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c48256-284e-4e9d-85d8-60f877ce2d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:20.896475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-07c48256-284e-4e9d-85d8-60f877ce2d80 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:20.897692 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-07c48256-284e-4e9d-85d8-60f877ce2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:20.960078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1217/2428] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:20.970076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:20.971567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:21.030283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6048e4-d7b1-4c9c-b6b1-1be3500ebb4a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:21.033951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997ebc3-8f9f-47e1-a68e-68756fbe678e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:21.034701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ebc3-8f9f-47e1-a68e-68756fbe678e service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:21.034988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ebc3-8f9f-47e1-a68e-68756fbe678e service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:21.035265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997ebc3-8f9f-47e1-a68e-68756fbe678e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:21.044919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997ebc3-8f9f-47e1-a68e-68756fbe678e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:21.046454 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997ebc3-8f9f-47e1-a68e-68756fbe678e service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:21.055845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1212/2429] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:21.512696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48256-284e-4e9d-85d8-60f877ce2d80 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:21.514362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-07c48256-284e-4e9d-85d8-60f877ce2d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:21.532162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c48256-284e-4e9d-85d8-60f877ce2d80 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:21.536826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:21.537700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:21.537981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:21.538251 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] PATH_INFO: `/v3/projects/f096d4228eb441ebb1154d592d50b408` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:21.539703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f096d4228eb441ebb1154d592d50b408)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:21.542463 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:21.655156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f096d4228eb441ebb1154d592d50b408', 'request_id': 'req-f8cd1b08-1577-4a4f-9196-dde1b84206b9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:21.660728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f096d4228eb441ebb1154d592d50b408', 'request_id': 'req-f8cd1b08-1577-4a4f-9196-dde1b84206b9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:21.721788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f096d4228eb441ebb1154d592d50b408', 'request_id': 'req-f8cd1b08-1577-4a4f-9196-dde1b84206b9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:21.733273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] The token cache is being invalidate because project f096d4228eb441ebb1154d592d50b408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:51:21.734372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:21.734372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:51:21.735773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1218/2430] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:51:21 2022] DELETE /identity/v3/projects/f096d4228eb441ebb1154d592d50b408 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:51:29.154968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d6a6-3f7b-433f-8f94-1daa11a5e810 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:29.155449 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d6a6-3f7b-433f-8f94-1daa11a5e810 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:29.155567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4d6a6-3f7b-433f-8f94-1daa11a5e810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:29.172981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fea4d6a6-3f7b-433f-8f94-1daa11a5e810 None None] MFA Rules not processed for user `98a275f65a3544a5b073fbf1ee10034b`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:29.174180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fea4d6a6-3f7b-433f-8f94-1daa11a5e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:29.190504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:29.229333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1213/2431] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:31.730065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:39.383719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=15 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:43.583758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:43.585207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:43.643607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd1b08-1577-4a4f-9196-dde1b84206b9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:43.647192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:43.647839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:43.648122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:43.648399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:43.650168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:43.712443 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:43.713914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:43.724473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1219/2432] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:51:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:44.094110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af8c15-db22-4426-a6d2-8edddf8598f8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:44.094110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af8c15-db22-4426-a6d2-8edddf8598f8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:44.094110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af8c15-db22-4426-a6d2-8edddf8598f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:44.113827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-41af8c15-db22-4426-a6d2-8edddf8598f8 None None] MFA Rules not processed for user `b1933169d9a94afb9393d35f3a523c25`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:51:44.115567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-41af8c15-db22-4426-a6d2-8edddf8598f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:44.173971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1214/2433] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:51:45.924442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:51:45.925905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:45.938084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38dd6c-e2e3-4778-9e44-5fa3acebcd99 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:51:45.941882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:51:45.942602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:51:45.942889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:51:45.943164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:51:45.945310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:51:46.017618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:51:46.019255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:51:46.029918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1220/2434] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:51:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:51:54.166327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=25 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:51:56.026353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=80 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:17.718557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156853c-c442-4ca1-affb-00b6229a7964 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:17.719057 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156853c-c442-4ca1-affb-00b6229a7964 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:17.719154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156853c-c442-4ca1-affb-00b6229a7964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:17.737376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c156853c-c442-4ca1-affb-00b6229a7964 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:17.738672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c156853c-c442-4ca1-affb-00b6229a7964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:17.795711 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1215/2435] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:17.838992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:17.840471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:17.910846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3fcee-5547-4e0c-8d37-8e06b4cfc1cc service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:17.916474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b80c-646c-4333-ae20-ebca68d6e4e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:17.917189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b80c-646c-4333-ae20-ebca68d6e4e9 service swift] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:17.917492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b80c-646c-4333-ae20-ebca68d6e4e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:17.917779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b80c-646c-4333-ae20-ebca68d6e4e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:17.926112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3b80c-646c-4333-ae20-ebca68d6e4e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:17.927841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3b80c-646c-4333-ae20-ebca68d6e4e9 service swift] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:17.936020 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1221/2436] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:52:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:52:27.787976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=25 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:27.932736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=32 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:33.601437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156853c-c442-4ca1-affb-00b6229a7964 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:33.613356 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156853c-c442-4ca1-affb-00b6229a7964 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:33.617806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:33.625002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:33.625002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:33.625002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:33.625002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:33.694973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:33.696462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:33.708635 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1216/2437] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:35.228125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089be91-7f64-44cf-9719-c345ebf5c8a0 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:35.228616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089be91-7f64-44cf-9719-c345ebf5c8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:35.228714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089be91-7f64-44cf-9719-c345ebf5c8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:35.247422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5089be91-7f64-44cf-9719-c345ebf5c8a0 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:35.248608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5089be91-7f64-44cf-9719-c345ebf5c8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:35.255731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1222/2438] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 26 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:35.272215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:35.281050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bf091-033f-4335-9fb9-405194aca699 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:35.286013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e65fb8-2d4e-4824-b355-e887397e47ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:35.286701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65fb8-2d4e-4824-b355-e887397e47ee service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:35.286984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65fb8-2d4e-4824-b355-e887397e47ee service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:35.287260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e65fb8-2d4e-4824-b355-e887397e47ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:35.296353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e65fb8-2d4e-4824-b355-e887397e47ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:35.297938 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e65fb8-2d4e-4824-b355-e887397e47ee service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:35.306861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1217/2439] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:52:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:52:37.235040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089be91-7f64-44cf-9719-c345ebf5c8a0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:37.245362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089be91-7f64-44cf-9719-c345ebf5c8a0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:37.249058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e87213-f18f-436a-ae68-bfd55c829132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:37.249731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87213-f18f-436a-ae68-bfd55c829132 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:37.250016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87213-f18f-436a-ae68-bfd55c829132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:37.250294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e87213-f18f-436a-ae68-bfd55c829132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:37.252147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-91e87213-f18f-436a-ae68-bfd55c829132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:37.266387 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e87213-f18f-436a-ae68-bfd55c829132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:37.267849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e87213-f18f-436a-ae68-bfd55c829132 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:37.279630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1223/2440] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:38.555090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdfa89-e3b3-427b-9dd8-c5f64d679b85 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:38.555643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdfa89-e3b3-427b-9dd8-c5f64d679b85 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:38.555643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdfa89-e3b3-427b-9dd8-c5f64d679b85 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:38.557043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1218/2441] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:52:38.567421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041586d2-3f61-4fae-87fe-56721a0dd604 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:38.567892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041586d2-3f61-4fae-87fe-56721a0dd604 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:38.568068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041586d2-3f61-4fae-87fe-56721a0dd604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:38.605851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-041586d2-3f61-4fae-87fe-56721a0dd604 None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:38.607076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-041586d2-3f61-4fae-87fe-56721a0dd604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:38.669801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1224/2442] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:52:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:52:38.681675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdfa89-e3b3-427b-9dd8-c5f64d679b85 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:38.683401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6fbdfa89-e3b3-427b-9dd8-c5f64d679b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:38.698538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041586d2-3f61-4fae-87fe-56721a0dd604 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:38.700518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-041586d2-3f61-4fae-87fe-56721a0dd604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:38.701637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbdfa89-e3b3-427b-9dd8-c5f64d679b85 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:38.706985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91f7c4-09bf-471a-83c0-5fea31d363a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:38.707641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f7c4-09bf-471a-83c0-5fea31d363a9 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:38.707943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f7c4-09bf-471a-83c0-5fea31d363a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:38.708379 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91f7c4-09bf-471a-83c0-5fea31d363a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:38.719456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91f7c4-09bf-471a-83c0-5fea31d363a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:38.721054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91f7c4-09bf-471a-83c0-5fea31d363a9 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:38.733973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1219/2443] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:52:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:38.774217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041586d2-3f61-4fae-87fe-56721a0dd604 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:38.778735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:38.779607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:38.779888 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:38.780160 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] PATH_INFO: `/v3/users/b1933169d9a94afb9393d35f3a523c25` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:38.781358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1933169d9a94afb9393d35f3a523c25)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:38.783312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:38.969846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1933169d9a94afb9393d35f3a523c25'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:38.970508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1933169d9a94afb9393d35f3a523c25'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:38.977493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1933169d9a94afb9393d35f3a523c25'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:38.989203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:38.989448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1933169d9a94afb9393d35f3a523c25'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:38.990104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6f495148-1cb4-484a-aacd-800cb13ad510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1933169d9a94afb9393d35f3a523c25'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:39.076261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1225/2444] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:52:38 2022] DELETE /identity/v3/users/b1933169d9a94afb9393d35f3a523c25 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:52:39.342902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91f7c4-09bf-471a-83c0-5fea31d363a9 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:39.354248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91f7c4-09bf-471a-83c0-5fea31d363a9 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:39.416091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:39.416952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:39.417235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:39.417505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] PATH_INFO: `/v3/projects/b2c3cf0851794497aac57c9d2fbfc6da` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:39.418728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c3cf0851794497aac57c9d2fbfc6da)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:39.420629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:39.552066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c3cf0851794497aac57c9d2fbfc6da', 'request_id': 'req-89eed277-6dce-4432-a307-fced3432854a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:39.558941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c3cf0851794497aac57c9d2fbfc6da', 'request_id': 'req-89eed277-6dce-4432-a307-fced3432854a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:39.563581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:52:39.564763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c3cf0851794497aac57c9d2fbfc6da', 'request_id': 'req-89eed277-6dce-4432-a307-fced3432854a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:39.705764 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] The token cache is being invalidate because project b2c3cf0851794497aac57c9d2fbfc6da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:52:39.706094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:39.706795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:52:39.714119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1220/2445] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:52:39 2022] DELETE /identity/v3/projects/b2c3cf0851794497aac57c9d2fbfc6da => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:52:48.388458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a2fa-6888-43ee-9491-e6f1298e7dc3 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:48.388959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a2fa-6888-43ee-9491-e6f1298e7dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:48.389059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a2fa-6888-43ee-9491-e6f1298e7dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:48.407036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4575a2fa-6888-43ee-9491-e6f1298e7dc3 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:52:48.408247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4575a2fa-6888-43ee-9491-e6f1298e7dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:48.463767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1226/2446] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:52:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:52:48.475716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:48.477151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:48.545540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eed277-6dce-4432-a307-fced3432854a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:48.550816 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:48.551467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:48.552259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:48.553023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:48.561331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:48.562983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:48.572526 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1221/2447] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:52:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:52:50.247164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a2fa-6888-43ee-9491-e6f1298e7dc3 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:52:50.248946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4575a2fa-6888-43ee-9491-e6f1298e7dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:50.374778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a2fa-6888-43ee-9491-e6f1298e7dc3 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:52:50.381363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:52:50.382029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:52:50.382310 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:52:50.382610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:52:50.384474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:52:50.461182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:52:50.462801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:52:50.478583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1227/2448] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:52:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:52:58.567918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=35,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:00.469855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=86,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:00.924499 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:00.925983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:00.993374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff127-f36a-4a67-9d02-3aacebb72bc4 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:00.998791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbbd47-2d03-4712-bfde-a9571bdb5aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:00.998791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbbd47-2d03-4712-bfde-a9571bdb5aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:00.998791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbbd47-2d03-4712-bfde-a9571bdb5aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:00.998791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbbd47-2d03-4712-bfde-a9571bdb5aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:01.000126 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e2dbbd47-2d03-4712-bfde-a9571bdb5aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:01.012784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbbd47-2d03-4712-bfde-a9571bdb5aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:01.014211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbbd47-2d03-4712-bfde-a9571bdb5aaf service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:01.024260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1222/2449] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:05.931796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:05.933297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:05.946182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5df1c4-9b90-46cc-9ffa-c2346caa69e5 service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:05.950391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad239047-c27a-4b2e-a563-8d34fdc18242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:05.951076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad239047-c27a-4b2e-a563-8d34fdc18242 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:05.951361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad239047-c27a-4b2e-a563-8d34fdc18242 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:05.951635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad239047-c27a-4b2e-a563-8d34fdc18242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:05.953425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ad239047-c27a-4b2e-a563-8d34fdc18242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:05.964551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad239047-c27a-4b2e-a563-8d34fdc18242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:05.965991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad239047-c27a-4b2e-a563-8d34fdc18242 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:05.974138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1228/2450] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:06.334089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355bcb-1077-40a5-8441-7e33a56184cf None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.334089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355bcb-1077-40a5-8441-7e33a56184cf None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.334089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82355bcb-1077-40a5-8441-7e33a56184cf None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.334089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1223/2451] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:53:06.338727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fb239-47d1-4f12-963c-ff39f256c269 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.339044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fb239-47d1-4f12-963c-ff39f256c269 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.339383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fb239-47d1-4f12-963c-ff39f256c269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.379459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-750fb239-47d1-4f12-963c-ff39f256c269 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:06.381841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-750fb239-47d1-4f12-963c-ff39f256c269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:06.392525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1229/2452] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:06.404034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82355bcb-1077-40a5-8441-7e33a56184cf None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:06.405753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-82355bcb-1077-40a5-8441-7e33a56184cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:06.464011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82355bcb-1077-40a5-8441-7e33a56184cf None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:06.467535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c83a14-dc9b-44bc-9ebf-bfc2d70c725c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:06.468121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c83a14-dc9b-44bc-9ebf-bfc2d70c725c service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.468399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c83a14-dc9b-44bc-9ebf-bfc2d70c725c service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.468675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c83a14-dc9b-44bc-9ebf-bfc2d70c725c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.479643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c83a14-dc9b-44bc-9ebf-bfc2d70c725c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:06.481075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c83a14-dc9b-44bc-9ebf-bfc2d70c725c service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:06.492819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1224/2453] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:06.692157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d3a9e-c076-4fd2-95fa-b7f98bb00447 None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.692446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d3a9e-c076-4fd2-95fa-b7f98bb00447 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.693821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d3a9e-c076-4fd2-95fa-b7f98bb00447 None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.695271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1230/2454] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:53:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:53:06.700045 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8c250-9eaf-4dbe-9ff7-973a0efeb5e1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.700334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8c250-9eaf-4dbe-9ff7-973a0efeb5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.700617 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b8c250-9eaf-4dbe-9ff7-973a0efeb5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.721427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-20b8c250-9eaf-4dbe-9ff7-973a0efeb5e1 None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:06.721427 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-20b8c250-9eaf-4dbe-9ff7-973a0efeb5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:06.727466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1225/2455] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:06.740098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d3a9e-c076-4fd2-95fa-b7f98bb00447 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:06.750991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d3a9e-c076-4fd2-95fa-b7f98bb00447 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:06.754553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54dc8d-78bb-4f00-a3e2-8d1aae06f5db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:06.755314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54dc8d-78bb-4f00-a3e2-8d1aae06f5db service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.755587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54dc8d-78bb-4f00-a3e2-8d1aae06f5db service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.755857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54dc8d-78bb-4f00-a3e2-8d1aae06f5db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.763295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54dc8d-78bb-4f00-a3e2-8d1aae06f5db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:06.764700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54dc8d-78bb-4f00-a3e2-8d1aae06f5db service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:06.772835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1231/2456] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:06.853495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1901-9703-4881-b905-640586f4bc79 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.853882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1901-9703-4881-b905-640586f4bc79 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.854600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e1901-9703-4881-b905-640586f4bc79 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.855804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1226/2457] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:53:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:53:06.860900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd47ecf-9ad4-4c59-b251-39242a0ca2fc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.861191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd47ecf-9ad4-4c59-b251-39242a0ca2fc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.861470 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd47ecf-9ad4-4c59-b251-39242a0ca2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.881257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7bd47ecf-9ad4-4c59-b251-39242a0ca2fc None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:06.882490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7bd47ecf-9ad4-4c59-b251-39242a0ca2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:06.892261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1232/2458] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:06.902568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e1901-9703-4881-b905-640586f4bc79 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:06.914020 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e1901-9703-4881-b905-640586f4bc79 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:06.917592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c6d45-3c9c-4a60-9353-0077d42fbc60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:06.918231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6d45-3c9c-4a60-9353-0077d42fbc60 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:06.918513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6d45-3c9c-4a60-9353-0077d42fbc60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:06.918819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c6d45-3c9c-4a60-9353-0077d42fbc60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:06.929765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6d45-3c9c-4a60-9353-0077d42fbc60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:06.931211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c6d45-3c9c-4a60-9353-0077d42fbc60 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:06.941814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1227/2459] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:07.006735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd47ecf-9ad4-4c59-b251-39242a0ca2fc None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:07.008324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7bd47ecf-9ad4-4c59-b251-39242a0ca2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:07.078306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd47ecf-9ad4-4c59-b251-39242a0ca2fc None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:07.084356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:07.085009 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:07.085295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:07.085571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:07.087374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:07.098423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:07.100999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:07.110646 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1233/2460] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:11.243575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9932-7de0-4557-9a11-81713b2ab4ab None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:11.244079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9932-7de0-4557-9a11-81713b2ab4ab None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:11.244281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa9932-7de0-4557-9a11-81713b2ab4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:11.262325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-54aa9932-7de0-4557-9a11-81713b2ab4ab None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:11.263573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-54aa9932-7de0-4557-9a11-81713b2ab4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:11.270719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1228/2461] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:53:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:11.284145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:11.295248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ddf98-1820-454a-835b-5da6de9cdd20 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:11.300266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e022b4-614c-4407-9c1a-635d1510049b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:11.300915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e022b4-614c-4407-9c1a-635d1510049b service swift] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:11.301199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e022b4-614c-4407-9c1a-635d1510049b service swift] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:11.301474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e022b4-614c-4407-9c1a-635d1510049b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:11.310341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e022b4-614c-4407-9c1a-635d1510049b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:11.311955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e022b4-614c-4407-9c1a-635d1510049b service swift] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:11.320029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1234/2462] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:53:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:53:21.256750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=64 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:21.317390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=62 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:53:36.218975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0dc59-703c-4d1d-be26-60db8feb305f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:36.219508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0dc59-703c-4d1d-be26-60db8feb305f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:36.219508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0dc59-703c-4d1d-be26-60db8feb305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:36.238766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ffd0dc59-703c-4d1d-be26-60db8feb305f None None] MFA Rules not processed for user `e24e8e8d0b8042bfb7ee7881aa8a16c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:36.242582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ffd0dc59-703c-4d1d-be26-60db8feb305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:36.246835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1229/2463] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:53:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:40.836302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e022b4-614c-4407-9c1a-635d1510049b service swift] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:40.851720 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e022b4-614c-4407-9c1a-635d1510049b service swift] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:40.857889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9b978-3826-432d-b096-81f273156e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:40.858728 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b978-3826-432d-b096-81f273156e4a service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:40.859220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b978-3826-432d-b096-81f273156e4a service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:40.859501 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9b978-3826-432d-b096-81f273156e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:40.861304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-2de9b978-3826-432d-b096-81f273156e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:40.874210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9b978-3826-432d-b096-81f273156e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:40.877314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9b978-3826-432d-b096-81f273156e4a service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:40.894347 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1235/2464] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:43.853187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0dc59-703c-4d1d-be26-60db8feb305f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:43.867772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0dc59-703c-4d1d-be26-60db8feb305f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:43.879227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:43.879227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:43.879227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:43.879227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:43.880321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:43.893472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:43.895085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:43.905657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1230/2465] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:44.825974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666570-b7f3-4ca4-b559-40c025ae551f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:44.826482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666570-b7f3-4ca4-b559-40c025ae551f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:44.826738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c666570-b7f3-4ca4-b559-40c025ae551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:44.845830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-0c666570-b7f3-4ca4-b559-40c025ae551f None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:53:44.847763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0c666570-b7f3-4ca4-b559-40c025ae551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:44.854901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1236/2466] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 26 12:53:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:53:44.878918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:44.890435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ccc99c-d9db-4a3c-bc7e-6f0f99fe5371 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:44.895943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f18007-b3ca-454e-b6d8-82314e5d3990 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:44.896534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f18007-b3ca-454e-b6d8-82314e5d3990 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:44.896822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f18007-b3ca-454e-b6d8-82314e5d3990 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:44.897100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f18007-b3ca-454e-b6d8-82314e5d3990 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:44.905298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f18007-b3ca-454e-b6d8-82314e5d3990 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:44.906904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f18007-b3ca-454e-b6d8-82314e5d3990 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:44.915762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1231/2467] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:53:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 12:53:51.103223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666570-b7f3-4ca4-b559-40c025ae551f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:53:51.104669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0c666570-b7f3-4ca4-b559-40c025ae551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:51.121269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c666570-b7f3-4ca4-b559-40c025ae551f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:53:51.126716 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:53:51.127430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:53:51.127706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:53:51.127974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:53:51.129731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:53:51.187960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:53:51.189518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:53:51.198753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1237/2468] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:53:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:53:54.912518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=15 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:01.194358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=37 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:07.083736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dff1f-e81a-47f1-8fd3-c9ff51cab1c4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:07.084222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dff1f-e81a-47f1-8fd3-c9ff51cab1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:07.084319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2dff1f-e81a-47f1-8fd3-c9ff51cab1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:07.102338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cf2dff1f-e81a-47f1-8fd3-c9ff51cab1c4 None None] MFA Rules not processed for user `98a275f65a3544a5b073fbf1ee10034b`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:54:07.103700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cf2dff1f-e81a-47f1-8fd3-c9ff51cab1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:07.110925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1232/2469] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:54:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:54:07.417767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:07.427132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8a009-68f7-448e-b7a6-4dd6ac389697 service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:07.430630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:07.431267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:07.431545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:07.431816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:07.433535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:07.443186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:07.444572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:07.452319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1238/2470] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:54:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:54:17.097462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:17.448879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:54:54.198463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2dff1f-e81a-47f1-8fd3-c9ff51cab1c4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:54:54.211666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2dff1f-e81a-47f1-8fd3-c9ff51cab1c4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:54:54.217508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e840450f-798d-48fa-b03a-0f0b8fa25262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:54:54.218150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840450f-798d-48fa-b03a-0f0b8fa25262 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:54:54.218437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840450f-798d-48fa-b03a-0f0b8fa25262 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:54:54.218735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e840450f-798d-48fa-b03a-0f0b8fa25262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:54:54.220915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e840450f-798d-48fa-b03a-0f0b8fa25262 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:54:54.302587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840450f-798d-48fa-b03a-0f0b8fa25262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:54:54.304569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e840450f-798d-48fa-b03a-0f0b8fa25262 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:54:54.316183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1233/2471] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:54:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:00.463239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:00.478452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b245aa0-4899-4f3a-8182-474c31c381b1 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:00.484416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:00.485064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:00.485504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:00.485969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:00.489153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:00.523948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:00.525548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:00.540732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1239/2472] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:04.310288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=28 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:10.534799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:12.087118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41737101-357f-4091-969e-86a535608c6c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:12.087978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41737101-357f-4091-969e-86a535608c6c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:12.088258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41737101-357f-4091-969e-86a535608c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:12.109742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-41737101-357f-4091-969e-86a535608c6c None None] MFA Rules not processed for user `34cd6fbd9b654e31a387acc25ee94d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:12.111084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-41737101-357f-4091-969e-86a535608c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:12.120672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1234/2473] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:13.675398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:13.687453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8bc15-73ef-476b-924b-b4e17561cb34 service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:13.693781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:13.694436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:13.694765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:13.695041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:13.696981 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:13.760118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:13.761722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:13.770923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1240/2474] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:14.704735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1f4b0-f508-4d9c-b0f4-f4cdc24988d4 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:14.704735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1f4b0-f508-4d9c-b0f4-f4cdc24988d4 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:14.705278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f1f4b0-f508-4d9c-b0f4-f4cdc24988d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:14.724051 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-54f1f4b0-f508-4d9c-b0f4-f4cdc24988d4 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:14.725242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-54f1f4b0-f508-4d9c-b0f4-f4cdc24988d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:14.732488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1235/2475] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 26 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:14.946303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:14.958804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921eba7-4a4a-43f6-9c45-9a0007e43a4c service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:14.963978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:14.964636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:14.964953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:14.965231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:14.974095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:14.976986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:14.985080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1241/2476] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:55:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:55:16.052419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1f4b0-f508-4d9c-b0f4-f4cdc24988d4 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:16.063116 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f1f4b0-f508-4d9c-b0f4-f4cdc24988d4 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:16.068393 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:16.068581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:16.068771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:16.069053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:16.070942 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:16.159127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:16.166490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:16.174456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1236/2477] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:21.010608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:21.014725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:21.034158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cb51c8-6788-46c5-8dd5-12a7477ed604 service swift] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:21.041644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:21.042577 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:21.043073 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:21.043420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:21.045270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:21.059585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:21.061429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:21.072741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1242/2478] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:23.635170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:23.644975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bf8cb-664b-4700-9210-0f4187f0ec48 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:23.649249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:23.649920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:23.650310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:23.650667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:23.652704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:23.665485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:23.667841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:23.677982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1237/2479] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:26.056758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:26.064750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:26.080999 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88781e74-db21-4527-b0c9-e4eb3147c236 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:26.090848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:26.092063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:26.092414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:26.092754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] PATH_INFO: `/v3/users/db52c21a4c58422fa7ccad6232fc8f21` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:26.094863 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db52c21a4c58422fa7ccad6232fc8f21)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:26.099137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:26.331632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db52c21a4c58422fa7ccad6232fc8f21'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:26.332603 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db52c21a4c58422fa7ccad6232fc8f21'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:26.342435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db52c21a4c58422fa7ccad6232fc8f21'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:26.355977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db52c21a4c58422fa7ccad6232fc8f21'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:26.357057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db52c21a4c58422fa7ccad6232fc8f21'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:26.432173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1243/2480] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:26 2022] DELETE /identity/v3/users/db52c21a4c58422fa7ccad6232fc8f21 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:26.727788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:26.739426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b042bb-6206-477c-bba4-1dcc4ad99e15 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:26.805159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:26.805986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:26.806264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:26.806584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] PATH_INFO: `/v3/projects/b7059688f7a24761b61e51820c78a2ab` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:26.807827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7059688f7a24761b61e51820c78a2ab)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:26.809720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:26.941453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7059688f7a24761b61e51820c78a2ab', 'request_id': 'req-0b108290-2c43-4e0a-b348-e9ccc1826649'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:26.947567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7059688f7a24761b61e51820c78a2ab', 'request_id': 'req-0b108290-2c43-4e0a-b348-e9ccc1826649'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:26.953091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7059688f7a24761b61e51820c78a2ab', 'request_id': 'req-0b108290-2c43-4e0a-b348-e9ccc1826649'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:27.047348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:27.052889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] The token cache is being invalidate because project b7059688f7a24761b61e51820c78a2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:27.053204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:27.054030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:27.055886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1238/2481] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:26 2022] DELETE /identity/v3/projects/b7059688f7a24761b61e51820c78a2ab => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:27.060389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:27.062074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:27.077848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362b7d7-3caa-4e9e-8db3-192d5b45c45f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:27.124049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:27.139985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:27.140877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:27.141157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:27.141431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] PATH_INFO: `/v3/users/fa3ce802f8d44bfd9232dcc4879fcacf` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:27.142654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3ce802f8d44bfd9232dcc4879fcacf)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:27.144965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:27.407936 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3ce802f8d44bfd9232dcc4879fcacf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:27.410801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3ce802f8d44bfd9232dcc4879fcacf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:27.426097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3ce802f8d44bfd9232dcc4879fcacf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:27.443614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3ce802f8d44bfd9232dcc4879fcacf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:27.444442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3ce802f8d44bfd9232dcc4879fcacf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:27.529737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1244/2482] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:27 2022] DELETE /identity/v3/users/fa3ce802f8d44bfd9232dcc4879fcacf => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:27.882680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:27.882680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:27.897889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b108290-2c43-4e0a-b348-e9ccc1826649 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:27.975214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:27.976046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:27.976326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:27.976601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] PATH_INFO: `/v3/projects/e9cad045f0f24aa9811e2933ab77e664` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:27.977798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9cad045f0f24aa9811e2933ab77e664)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:27.979771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:28.232156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9cad045f0f24aa9811e2933ab77e664', 'request_id': 'req-dc0d857c-6ad5-40aa-8e37-1467a43091b6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.238574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9cad045f0f24aa9811e2933ab77e664', 'request_id': 'req-dc0d857c-6ad5-40aa-8e37-1467a43091b6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.244070 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9cad045f0f24aa9811e2933ab77e664', 'request_id': 'req-dc0d857c-6ad5-40aa-8e37-1467a43091b6'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.261895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:28.263393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:28.278867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b1547-04af-4466-89e0-2743b94bea08 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:28.338181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:28.339170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:28.339363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:28.339639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] PATH_INFO: `/v3/users/e24e8e8d0b8042bfb7ee7881aa8a16c1` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:28.340824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24e8e8d0b8042bfb7ee7881aa8a16c1)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:28.342765 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:28.397797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] The token cache is being invalidate because project e9cad045f0f24aa9811e2933ab77e664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:28.398089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.398747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.400320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1239/2483] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:27 2022] DELETE /identity/v3/projects/e9cad045f0f24aa9811e2933ab77e664 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:28.644085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24e8e8d0b8042bfb7ee7881aa8a16c1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.645899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24e8e8d0b8042bfb7ee7881aa8a16c1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.653694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24e8e8d0b8042bfb7ee7881aa8a16c1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.661076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:28.679495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24e8e8d0b8042bfb7ee7881aa8a16c1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.679495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-75daae1f-797a-43a6-bebb-1a5651c111d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24e8e8d0b8042bfb7ee7881aa8a16c1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:28.790048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1245/2484] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:28 2022] DELETE /identity/v3/users/e24e8e8d0b8042bfb7ee7881aa8a16c1 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:55:29.072655 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:29.074168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:29.089932 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d857c-6ad5-40aa-8e37-1467a43091b6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:29.154690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:29.155694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:29.155988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:29.156270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] PATH_INFO: `/v3/projects/98c0c747833441bda0a5f8d62de53cd3` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:29.157465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=98c0c747833441bda0a5f8d62de53cd3)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:29.160099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:29.292221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:29.305714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98c0c747833441bda0a5f8d62de53cd3', 'request_id': 'req-8dc4e955-c988-4bec-8080-b5aaf8785eff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:29.312600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98c0c747833441bda0a5f8d62de53cd3', 'request_id': 'req-8dc4e955-c988-4bec-8080-b5aaf8785eff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:29.321453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98c0c747833441bda0a5f8d62de53cd3', 'request_id': 'req-8dc4e955-c988-4bec-8080-b5aaf8785eff'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:29.425615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] The token cache is being invalidate because project 98c0c747833441bda0a5f8d62de53cd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:29.425895 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:29.426571 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8dc4e955-c988-4bec-8080-b5aaf8785eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:29.428232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1240/2485] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:29 2022] DELETE /identity/v3/projects/98c0c747833441bda0a5f8d62de53cd3 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:29.438452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930115-aceb-4e79-bbff-6d57e7b7926a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:29.438985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930115-aceb-4e79-bbff-6d57e7b7926a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:29.439098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92930115-aceb-4e79-bbff-6d57e7b7926a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:29.459661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-92930115-aceb-4e79-bbff-6d57e7b7926a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:29.460906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-92930115-aceb-4e79-bbff-6d57e7b7926a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:29.525974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1246/2486] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:29.533659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319392d8-26f1-40c5-be82-e3967c8b22b6 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:29.533949 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319392d8-26f1-40c5-be82-e3967c8b22b6 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:29.534226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319392d8-26f1-40c5-be82-e3967c8b22b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:29.553395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-319392d8-26f1-40c5-be82-e3967c8b22b6 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:29.554614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-319392d8-26f1-40c5-be82-e3967c8b22b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:29.562940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1241/2487] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:29.567812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930115-aceb-4e79-bbff-6d57e7b7926a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:29.578309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92930115-aceb-4e79-bbff-6d57e7b7926a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:29.583409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:29.584085 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:29.584370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:29.584659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:29.585401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:55:29.585711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:29.587340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:29.599689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1247/2488] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:55:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:55:29.605608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319392d8-26f1-40c5-be82-e3967c8b22b6 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:29.616476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319392d8-26f1-40c5-be82-e3967c8b22b6 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:29.621359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089572d-4d43-4b5a-96ea-d6543b6ffb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:29.622035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089572d-4d43-4b5a-96ea-d6543b6ffb06 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:29.622320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089572d-4d43-4b5a-96ea-d6543b6ffb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:29.622628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089572d-4d43-4b5a-96ea-d6543b6ffb06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:29.623330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089572d-4d43-4b5a-96ea-d6543b6ffb06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:29.625490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089572d-4d43-4b5a-96ea-d6543b6ffb06 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:29.733572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1242/2489] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:55:29 2022] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:29.738573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:29.748872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b510c23-0a17-40db-8ced-958de6e3f12b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:29.808155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de69b6b-1cc3-425b-bb90-05a6721d0308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:29.808832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de69b6b-1cc3-425b-bb90-05a6721d0308 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:29.809108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de69b6b-1cc3-425b-bb90-05a6721d0308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:29.809380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de69b6b-1cc3-425b-bb90-05a6721d0308 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:29.810293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de69b6b-1cc3-425b-bb90-05a6721d0308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:29.812303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de69b6b-1cc3-425b-bb90-05a6721d0308 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:29.951169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1248/2490] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:55:29 2022] POST /identity/v3/users => generated 282 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:55:29.955411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089572d-4d43-4b5a-96ea-d6543b6ffb06 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:29.965753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089572d-4d43-4b5a-96ea-d6543b6ffb06 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:29.971129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfa103-1c84-42ee-97c6-93f0ec5c3c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:29.972650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa103-1c84-42ee-97c6-93f0ec5c3c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:29.973118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa103-1c84-42ee-97c6-93f0ec5c3c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:29.973564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa103-1c84-42ee-97c6-93f0ec5c3c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:29.975149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfa103-1c84-42ee-97c6-93f0ec5c3c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:29.977256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfa103-1c84-42ee-97c6-93f0ec5c3c4d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:29.991679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1243/2491] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:55:29.994669 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de69b6b-1cc3-425b-bb90-05a6721d0308 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:30.006426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de69b6b-1cc3-425b-bb90-05a6721d0308 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:30.011466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912591dc-d09d-4601-9050-3995f7d2d20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:30.012241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912591dc-d09d-4601-9050-3995f7d2d20e admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.012810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912591dc-d09d-4601-9050-3995f7d2d20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.013319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912591dc-d09d-4601-9050-3995f7d2d20e admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.014006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912591dc-d09d-4601-9050-3995f7d2d20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:30.017604 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912591dc-d09d-4601-9050-3995f7d2d20e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:30.028452 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1249/2492] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:55:30.032669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfa103-1c84-42ee-97c6-93f0ec5c3c4d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:30.047012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfa103-1c84-42ee-97c6-93f0ec5c3c4d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:30.054986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156b19-2f95-49e0-ac2d-f3096accbdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:30.061401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156b19-2f95-49e0-ac2d-f3096accbdfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.061401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156b19-2f95-49e0-ac2d-f3096accbdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.061401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8156b19-2f95-49e0-ac2d-f3096accbdfe admin admin] PATH_INFO: `/v3/projects/6814da98ee1f4729b33aa8984c144763/users/2f66008cea9c48e4b76e8bcb787cd0ca/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.074131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8156b19-2f95-49e0-ac2d-f3096accbdfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6814da98ee1f4729b33aa8984c144763, user_id=2f66008cea9c48e4b76e8bcb787cd0ca, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:30.076840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8156b19-2f95-49e0-ac2d-f3096accbdfe admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:30.198486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1244/2493] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:30 2022] PUT /identity/v3/projects/6814da98ee1f4729b33aa8984c144763/users/2f66008cea9c48e4b76e8bcb787cd0ca/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:55:30.209117 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f316c02-13ea-498d-b248-057ec5fc2e48 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.209401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f316c02-13ea-498d-b248-057ec5fc2e48 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.209683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f316c02-13ea-498d-b248-057ec5fc2e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.239876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-3f316c02-13ea-498d-b248-057ec5fc2e48 None None] MFA Rules not processed for user `2f66008cea9c48e4b76e8bcb787cd0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:30.241172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3f316c02-13ea-498d-b248-057ec5fc2e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:30.290012 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:30.326070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1250/2494] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:30.327321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156b19-2f95-49e0-ac2d-f3096accbdfe admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:30.402446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8156b19-2f95-49e0-ac2d-f3096accbdfe admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:30.407587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf5e3d-c788-4f84-a84a-9d48b55c9672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:30.408358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf5e3d-c788-4f84-a84a-9d48b55c9672 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.408710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf5e3d-c788-4f84-a84a-9d48b55c9672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.409050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf5e3d-c788-4f84-a84a-9d48b55c9672 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.410110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf5e3d-c788-4f84-a84a-9d48b55c9672 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:30.412270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf5e3d-c788-4f84-a84a-9d48b55c9672 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:30.502165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1245/2495] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:55:30 2022] POST /identity/v3/projects => generated 363 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:30.506801 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f316c02-13ea-498d-b248-057ec5fc2e48 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:30.517904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f316c02-13ea-498d-b248-057ec5fc2e48 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:30.581745 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08fce2-ae4c-448f-8163-e29bfd1ac8f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:30.582652 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fce2-ae4c-448f-8163-e29bfd1ac8f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.582940 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fce2-ae4c-448f-8163-e29bfd1ac8f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.583218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c08fce2-ae4c-448f-8163-e29bfd1ac8f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.583959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08fce2-ae4c-448f-8163-e29bfd1ac8f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:30.585937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c08fce2-ae4c-448f-8163-e29bfd1ac8f6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:30.681961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1251/2496] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:55:30 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:55:30.686198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf5e3d-c788-4f84-a84a-9d48b55c9672 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:30.697198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf5e3d-c788-4f84-a84a-9d48b55c9672 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:30.702122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fd790-fbcf-40c8-969b-86e33c49116e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:30.702928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd790-fbcf-40c8-969b-86e33c49116e admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.703211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd790-fbcf-40c8-969b-86e33c49116e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.703486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fd790-fbcf-40c8-969b-86e33c49116e admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.704213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fd790-fbcf-40c8-969b-86e33c49116e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:30.705876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fd790-fbcf-40c8-969b-86e33c49116e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:30.717631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1246/2497] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:55:30.722630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08fce2-ae4c-448f-8163-e29bfd1ac8f6 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:30.733237 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c08fce2-ae4c-448f-8163-e29bfd1ac8f6 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:30.738858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ade7d4-cc2e-4dee-86af-6fe999a3aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:30.739782 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade7d4-cc2e-4dee-86af-6fe999a3aa4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.740083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade7d4-cc2e-4dee-86af-6fe999a3aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.740361 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ade7d4-cc2e-4dee-86af-6fe999a3aa4a admin admin] PATH_INFO: `/v3/projects/8c27ba103ba349c79de4596656503128/users/ce85cfcad3844db3afe49e6fceb7ea35/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.757833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ade7d4-cc2e-4dee-86af-6fe999a3aa4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c27ba103ba349c79de4596656503128, user_id=ce85cfcad3844db3afe49e6fceb7ea35, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:30.760456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ade7d4-cc2e-4dee-86af-6fe999a3aa4a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:30.857559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1252/2498] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:30 2022] PUT /identity/v3/projects/8c27ba103ba349c79de4596656503128/users/ce85cfcad3844db3afe49e6fceb7ea35/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:30.860055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fd790-fbcf-40c8-969b-86e33c49116e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:30.872363 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fd790-fbcf-40c8-969b-86e33c49116e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:30.890664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:30.934206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd7f1-e34f-4081-95d1-f571985daa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:30.934907 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd7f1-e34f-4081-95d1-f571985daa69 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.935204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd7f1-e34f-4081-95d1-f571985daa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.935478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd7f1-e34f-4081-95d1-f571985daa69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.936206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd7f1-e34f-4081-95d1-f571985daa69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:30.937792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd7f1-e34f-4081-95d1-f571985daa69 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:30.948717 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1247/2499] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:30.953018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ade7d4-cc2e-4dee-86af-6fe999a3aa4a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:30.964357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ade7d4-cc2e-4dee-86af-6fe999a3aa4a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:30.969269 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:30.970164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:30.970441 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:30.970748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] PATH_INFO: `/v3/projects/8c27ba103ba349c79de4596656503128/users/ce85cfcad3844db3afe49e6fceb7ea35/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:30.973542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c27ba103ba349c79de4596656503128, user_id=ce85cfcad3844db3afe49e6fceb7ea35, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:30.976184 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:30.988063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1253/2500] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:30 2022] PUT /identity/v3/projects/8c27ba103ba349c79de4596656503128/users/ce85cfcad3844db3afe49e6fceb7ea35/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:30.999279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190b029-4891-42ce-8585-944cbf19e98c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:31.000018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190b029-4891-42ce-8585-944cbf19e98c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:31.000120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190b029-4891-42ce-8585-944cbf19e98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:31.030585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c190b029-4891-42ce-8585-944cbf19e98c None None] MFA Rules not processed for user `ce85cfcad3844db3afe49e6fceb7ea35`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:31.031934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c190b029-4891-42ce-8585-944cbf19e98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:31.106406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1248/2501] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:31.117761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:31.119670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:31.182897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05f4832-4bd6-4e9a-a174-cdca77d42805 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:31.187934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff06c41-20ea-416b-a4ee-47b1180eaa33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:31.188601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff06c41-20ea-416b-a4ee-47b1180eaa33 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:31.188886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff06c41-20ea-416b-a4ee-47b1180eaa33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:31.189166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff06c41-20ea-416b-a4ee-47b1180eaa33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:31.199136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff06c41-20ea-416b-a4ee-47b1180eaa33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:31.200636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff06c41-20ea-416b-a4ee-47b1180eaa33 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:31.211139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1254/2502] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:32.195317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190b029-4891-42ce-8585-944cbf19e98c None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:32.258255 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190b029-4891-42ce-8585-944cbf19e98c None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:32.263108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:32.264134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:32.264419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:32.264700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] PATH_INFO: `/v3/users/2f66008cea9c48e4b76e8bcb787cd0ca` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:32.265922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f66008cea9c48e4b76e8bcb787cd0ca)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:32.267925 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:32.447510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f66008cea9c48e4b76e8bcb787cd0ca'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:32.448178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f66008cea9c48e4b76e8bcb787cd0ca'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:32.448695 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:32.449341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f66008cea9c48e4b76e8bcb787cd0ca'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:32.462222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f66008cea9c48e4b76e8bcb787cd0ca'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:32.468951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f66008cea9c48e4b76e8bcb787cd0ca'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:32.591048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1249/2503] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:32 2022] DELETE /identity/v3/users/2f66008cea9c48e4b76e8bcb787cd0ca => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:32.595767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1966-b3ac-4c1f-b8c6-77f43aad25d5 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:32.596242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1966-b3ac-4c1f-b8c6-77f43aad25d5 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:32.596358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c1966-b3ac-4c1f-b8c6-77f43aad25d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:32.614482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-615c1966-b3ac-4c1f-b8c6-77f43aad25d5 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:32.615784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-615c1966-b3ac-4c1f-b8c6-77f43aad25d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:32.646735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:32.675770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1255/2504] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:32.685424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:32.686890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:32.746940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae690b02-ae53-4364-b691-9ea0077fc37e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:32.750864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40ee9e-0fef-4c0f-9547-eff6d875bdc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:32.751516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ee9e-0fef-4c0f-9547-eff6d875bdc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:32.751815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ee9e-0fef-4c0f-9547-eff6d875bdc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:32.752078 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40ee9e-0fef-4c0f-9547-eff6d875bdc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:32.762074 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40ee9e-0fef-4c0f-9547-eff6d875bdc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:32.763548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a40ee9e-0fef-4c0f-9547-eff6d875bdc2 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:32.773668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1250/2505] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:33.203672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c1966-b3ac-4c1f-b8c6-77f43aad25d5 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:33.205294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-615c1966-b3ac-4c1f-b8c6-77f43aad25d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:33.217524 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c1966-b3ac-4c1f-b8c6-77f43aad25d5 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:33.223048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:33.223918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:33.224195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:33.224466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] PATH_INFO: `/v3/projects/6814da98ee1f4729b33aa8984c144763` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:33.225642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6814da98ee1f4729b33aa8984c144763)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:33.227674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:33.345624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6814da98ee1f4729b33aa8984c144763', 'request_id': 'req-f470d8a2-6f80-422e-ab64-e0e177b13e79'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.351023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6814da98ee1f4729b33aa8984c144763', 'request_id': 'req-f470d8a2-6f80-422e-ab64-e0e177b13e79'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.470439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6814da98ee1f4729b33aa8984c144763', 'request_id': 'req-f470d8a2-6f80-422e-ab64-e0e177b13e79'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.491196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] The token cache is being invalidate because project 6814da98ee1f4729b33aa8984c144763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:33.491480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.492130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.493698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1256/2506] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:33 2022] DELETE /identity/v3/projects/6814da98ee1f4729b33aa8984c144763 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:33.500567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40ee9e-0fef-4c0f-9547-eff6d875bdc2 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:33.510791 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40ee9e-0fef-4c0f-9547-eff6d875bdc2 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:33.567334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:33.568240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:33.568566 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:33.568985 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] PATH_INFO: `/v3/users/ce85cfcad3844db3afe49e6fceb7ea35` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:33.570290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce85cfcad3844db3afe49e6fceb7ea35)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:33.572432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:33.742396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce85cfcad3844db3afe49e6fceb7ea35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.743100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce85cfcad3844db3afe49e6fceb7ea35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.743747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce85cfcad3844db3afe49e6fceb7ea35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.756200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce85cfcad3844db3afe49e6fceb7ea35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.757382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:33.764024 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8bce3412-5433-405d-b04b-39912524cfa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce85cfcad3844db3afe49e6fceb7ea35'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:33.854260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1251/2507] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:33 2022] DELETE /identity/v3/users/ce85cfcad3844db3afe49e6fceb7ea35 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:34.294797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:34.296252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:34.309988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470d8a2-6f80-422e-ab64-e0e177b13e79 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:34.370455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:34.371346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:34.371629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:34.371901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] PATH_INFO: `/v3/projects/8c27ba103ba349c79de4596656503128` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:34.373066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c27ba103ba349c79de4596656503128)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:34.375304 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:34.509734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c27ba103ba349c79de4596656503128', 'request_id': 'req-c1046459-6f27-47f6-bccd-c7734cca9c8f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:34.515219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c27ba103ba349c79de4596656503128', 'request_id': 'req-c1046459-6f27-47f6-bccd-c7734cca9c8f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:34.516868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:34.611806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c27ba103ba349c79de4596656503128', 'request_id': 'req-c1046459-6f27-47f6-bccd-c7734cca9c8f'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:34.624205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] The token cache is being invalidate because project 8c27ba103ba349c79de4596656503128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:34.624748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:34.625376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c1046459-6f27-47f6-bccd-c7734cca9c8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:34.626947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1257/2508] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:34 2022] DELETE /identity/v3/projects/8c27ba103ba349c79de4596656503128 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:34.632657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb09056-d1f4-49f9-8457-99f7cc3f0592 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:34.633176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb09056-d1f4-49f9-8457-99f7cc3f0592 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:34.633323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb09056-d1f4-49f9-8457-99f7cc3f0592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:34.651187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0eb09056-d1f4-49f9-8457-99f7cc3f0592 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:34.652367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0eb09056-d1f4-49f9-8457-99f7cc3f0592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:34.711152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1252/2509] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:34.719128 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacc45-7d7c-4a2d-b03b-42adec67ada0 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:34.719418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacc45-7d7c-4a2d-b03b-42adec67ada0 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:34.719693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aacc45-7d7c-4a2d-b03b-42adec67ada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:34.739641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b0aacc45-7d7c-4a2d-b03b-42adec67ada0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:34.740857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b0aacc45-7d7c-4a2d-b03b-42adec67ada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:34.748812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1258/2510] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:34.755511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb09056-d1f4-49f9-8457-99f7cc3f0592 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:34.765255 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb09056-d1f4-49f9-8457-99f7cc3f0592 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:34.770556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:34.771265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:34.771578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:34.771805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:34.772531 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:55:34.772837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:34.774442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:34.786830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1253/2511] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:55:34.791259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aacc45-7d7c-4a2d-b03b-42adec67ada0 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:34.802158 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aacc45-7d7c-4a2d-b03b-42adec67ada0 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:34.806937 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47e10-3e17-47d0-8350-48852af7f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:34.807792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47e10-3e17-47d0-8350-48852af7f450 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:34.808284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47e10-3e17-47d0-8350-48852af7f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:34.808949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47e10-3e17-47d0-8350-48852af7f450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:34.809780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c47e10-3e17-47d0-8350-48852af7f450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:34.811719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c47e10-3e17-47d0-8350-48852af7f450 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:34.917173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1259/2512] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:55:34 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:34.921309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:34.932421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eb06c1-f5c7-4289-bc48-472fe8342e1d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:34.992418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4caba3-f9cc-4914-aeb3-78a492e88d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:34.993130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4caba3-f9cc-4914-aeb3-78a492e88d1e admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:34.993411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4caba3-f9cc-4914-aeb3-78a492e88d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:34.993689 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4caba3-f9cc-4914-aeb3-78a492e88d1e admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:34.994396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4caba3-f9cc-4914-aeb3-78a492e88d1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:34.996407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4caba3-f9cc-4914-aeb3-78a492e88d1e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:35.082518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1254/2513] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:55:34 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:55:35.086637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47e10-3e17-47d0-8350-48852af7f450 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:35.097831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47e10-3e17-47d0-8350-48852af7f450 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:35.102599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ac0d3-fb98-4cd6-9ee3-2f435153bdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:35.103261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ac0d3-fb98-4cd6-9ee3-2f435153bdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:35.103551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ac0d3-fb98-4cd6-9ee3-2f435153bdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:35.103822 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ac0d3-fb98-4cd6-9ee3-2f435153bdc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:35.104916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ac0d3-fb98-4cd6-9ee3-2f435153bdc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:35.106504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ac0d3-fb98-4cd6-9ee3-2f435153bdc6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:35.118502 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1260/2514] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:55:35.126666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4caba3-f9cc-4914-aeb3-78a492e88d1e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:35.137595 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4caba3-f9cc-4914-aeb3-78a492e88d1e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:35.142299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c60c77-c6d6-4c4b-ac91-b7ed85558a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:35.142989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c60c77-c6d6-4c4b-ac91-b7ed85558a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:35.143269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c60c77-c6d6-4c4b-ac91-b7ed85558a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:35.144073 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c60c77-c6d6-4c4b-ac91-b7ed85558a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:35.144560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c60c77-c6d6-4c4b-ac91-b7ed85558a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:35.146141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c60c77-c6d6-4c4b-ac91-b7ed85558a97 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:35.156467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1255/2515] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:35.166191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ac0d3-fb98-4cd6-9ee3-2f435153bdc6 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:35.177289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ac0d3-fb98-4cd6-9ee3-2f435153bdc6 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:35.181799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a642d-0261-4f64-ade5-768b2b69f67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:35.182828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a642d-0261-4f64-ade5-768b2b69f67e admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:35.183114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a642d-0261-4f64-ade5-768b2b69f67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:35.183388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a642d-0261-4f64-ade5-768b2b69f67e admin admin] PATH_INFO: `/v3/projects/2dcd09392e4e4260b429505db1252658/users/3f8327796c254d748b7a48caad94316c/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:35.198485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a642d-0261-4f64-ade5-768b2b69f67e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dcd09392e4e4260b429505db1252658, user_id=3f8327796c254d748b7a48caad94316c, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:35.201124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a642d-0261-4f64-ade5-768b2b69f67e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:35.303626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1261/2516] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:35 2022] PUT /identity/v3/projects/2dcd09392e4e4260b429505db1252658/users/3f8327796c254d748b7a48caad94316c/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:35.315031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ee42-a5be-455d-b70a-de9cac960269 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:35.315332 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ee42-a5be-455d-b70a-de9cac960269 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:35.315611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a873ee42-a5be-455d-b70a-de9cac960269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:35.342322 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a873ee42-a5be-455d-b70a-de9cac960269 None None] MFA Rules not processed for user `3f8327796c254d748b7a48caad94316c`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:35.343557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a873ee42-a5be-455d-b70a-de9cac960269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:35.381829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:35.407137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1256/2517] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:35 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:35.412341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a642d-0261-4f64-ade5-768b2b69f67e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:35.474642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a642d-0261-4f64-ade5-768b2b69f67e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:35.479250 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2083a0-7bfc-424f-8b7a-5abd479b2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:35.479898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2083a0-7bfc-424f-8b7a-5abd479b2545 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:35.480182 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2083a0-7bfc-424f-8b7a-5abd479b2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:35.480460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2083a0-7bfc-424f-8b7a-5abd479b2545 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:35.481149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2083a0-7bfc-424f-8b7a-5abd479b2545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:35.483100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2083a0-7bfc-424f-8b7a-5abd479b2545 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:35.802424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1262/2518] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:55:35 2022] POST /identity/v3/projects => generated 365 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:35.806346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873ee42-a5be-455d-b70a-de9cac960269 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:35.820772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a873ee42-a5be-455d-b70a-de9cac960269 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:35.878909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fbe8f-09ab-44d7-ba8f-4645f9067b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:35.879592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fbe8f-09ab-44d7-ba8f-4645f9067b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:35.879874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fbe8f-09ab-44d7-ba8f-4645f9067b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:35.880150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fbe8f-09ab-44d7-ba8f-4645f9067b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:35.880846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fbe8f-09ab-44d7-ba8f-4645f9067b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:35.882846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fbe8f-09ab-44d7-ba8f-4645f9067b01 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:35.990852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1257/2519] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:55:35 2022] POST /identity/v3/users => generated 289 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:35.995261 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2083a0-7bfc-424f-8b7a-5abd479b2545 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:36.006092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2083a0-7bfc-424f-8b7a-5abd479b2545 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:36.010631 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a9e00-596b-4202-acd2-770a955861ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:36.011288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a9e00-596b-4202-acd2-770a955861ef admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:36.011564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a9e00-596b-4202-acd2-770a955861ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:36.011834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a9e00-596b-4202-acd2-770a955861ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:36.012547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a9e00-596b-4202-acd2-770a955861ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:36.014121 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a9e00-596b-4202-acd2-770a955861ef admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:36.025116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1263/2520] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:36.029270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fbe8f-09ab-44d7-ba8f-4645f9067b01 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:36.040002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fbe8f-09ab-44d7-ba8f-4645f9067b01 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:36.044704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6324b-b2cf-4938-9d87-63844f71a847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:36.045587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6324b-b2cf-4938-9d87-63844f71a847 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:36.045864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6324b-b2cf-4938-9d87-63844f71a847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:36.046138 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6324b-b2cf-4938-9d87-63844f71a847 admin admin] PATH_INFO: `/v3/projects/19f486a9babf466cbd072e0ffcd9d7ce/users/9f1bd6d406504c83b1297e50d3068936/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:36.060699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6324b-b2cf-4938-9d87-63844f71a847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f486a9babf466cbd072e0ffcd9d7ce, user_id=9f1bd6d406504c83b1297e50d3068936, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:36.063275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6324b-b2cf-4938-9d87-63844f71a847 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:36.151282 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1258/2521] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:36 2022] PUT /identity/v3/projects/19f486a9babf466cbd072e0ffcd9d7ce/users/9f1bd6d406504c83b1297e50d3068936/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:36.155033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a9e00-596b-4202-acd2-770a955861ef admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:36.165431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a9e00-596b-4202-acd2-770a955861ef admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:36.217222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:36.223219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1d96-b246-40e4-9990-ccfb0821c5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:36.223893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1d96-b246-40e4-9990-ccfb0821c5af admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:36.224174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1d96-b246-40e4-9990-ccfb0821c5af admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:36.224450 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1d96-b246-40e4-9990-ccfb0821c5af admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:36.225173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1d96-b246-40e4-9990-ccfb0821c5af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:36.226794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1d96-b246-40e4-9990-ccfb0821c5af admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:36.236511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1264/2522] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:36.240758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6324b-b2cf-4938-9d87-63844f71a847 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:36.251402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6324b-b2cf-4938-9d87-63844f71a847 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:36.256796 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:36.257728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:36.258002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:36.258271 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] PATH_INFO: `/v3/projects/19f486a9babf466cbd072e0ffcd9d7ce/users/9f1bd6d406504c83b1297e50d3068936/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:36.260269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f486a9babf466cbd072e0ffcd9d7ce, user_id=9f1bd6d406504c83b1297e50d3068936, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:36.263034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:36.274770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1259/2523] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:36 2022] PUT /identity/v3/projects/19f486a9babf466cbd072e0ffcd9d7ce/users/9f1bd6d406504c83b1297e50d3068936/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:36.291829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2c16a-270b-4283-a799-97b27091902a None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:36.292162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2c16a-270b-4283-a799-97b27091902a None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:36.292455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2c16a-270b-4283-a799-97b27091902a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:36.320838 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-88b2c16a-270b-4283-a799-97b27091902a None None] MFA Rules not processed for user `9f1bd6d406504c83b1297e50d3068936`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:36.322108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-88b2c16a-270b-4283-a799-97b27091902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:36.396204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1265/2524] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:36 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:36.407685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:36.409860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:36.471678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ab1c5-da0a-4ff8-9d8b-843f30275ce3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:36.475492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309f78-0317-4130-b2ea-9bff5f5c67d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:36.476263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309f78-0317-4130-b2ea-9bff5f5c67d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:36.476547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309f78-0317-4130-b2ea-9bff5f5c67d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:36.476819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309f78-0317-4130-b2ea-9bff5f5c67d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:36.486844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b309f78-0317-4130-b2ea-9bff5f5c67d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:36.488848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b309f78-0317-4130-b2ea-9bff5f5c67d2 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:36.498967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1260/2525] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:36.733407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2c16a-270b-4283-a799-97b27091902a None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:36.743828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2c16a-270b-4283-a799-97b27091902a None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:36.747341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c301d8b-7a62-42f1-838e-d9bec1291ae9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:36.747988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301d8b-7a62-42f1-838e-d9bec1291ae9 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:36.748267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301d8b-7a62-42f1-838e-d9bec1291ae9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:36.748541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c301d8b-7a62-42f1-838e-d9bec1291ae9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:36.806400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c301d8b-7a62-42f1-838e-d9bec1291ae9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:36.807856 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c301d8b-7a62-42f1-838e-d9bec1291ae9 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:36.817506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1266/2526] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:40.548852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309f78-0317-4130-b2ea-9bff5f5c67d2 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:40.589889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:40.619264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309f78-0317-4130-b2ea-9bff5f5c67d2 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:40.624044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:40.625247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:40.625527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:40.625801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] PATH_INFO: `/v3/users/3f8327796c254d748b7a48caad94316c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:40.627005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8327796c254d748b7a48caad94316c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:40.629069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:40.862061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8327796c254d748b7a48caad94316c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:40.862867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8327796c254d748b7a48caad94316c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:40.864129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8327796c254d748b7a48caad94316c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:40.876530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8327796c254d748b7a48caad94316c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:40.883385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8327796c254d748b7a48caad94316c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:40.968547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1261/2527] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:40 2022] DELETE /identity/v3/users/3f8327796c254d748b7a48caad94316c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:40.974096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84072-ce0d-4176-85b0-599f0c00e4cb None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:40.974611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84072-ce0d-4176-85b0-599f0c00e4cb None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:40.974746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b84072-ce0d-4176-85b0-599f0c00e4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:40.991953 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-26b84072-ce0d-4176-85b0-599f0c00e4cb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:40.993170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-26b84072-ce0d-4176-85b0-599f0c00e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:41.053017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1267/2528] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:41.062737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:41.064163 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:41.120781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d620e-5292-47cd-a600-bd0517e31fa1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:41.124781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9589-123a-4c4b-9b7b-5b9c3a498396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:41.125529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9589-123a-4c4b-9b7b-5b9c3a498396 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:41.125896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9589-123a-4c4b-9b7b-5b9c3a498396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:41.126176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c9589-123a-4c4b-9b7b-5b9c3a498396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:41.137307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9589-123a-4c4b-9b7b-5b9c3a498396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:41.138973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1c9589-123a-4c4b-9b7b-5b9c3a498396 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:41.152121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1262/2529] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:41.667029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b84072-ce0d-4176-85b0-599f0c00e4cb None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:41.668488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-26b84072-ce0d-4176-85b0-599f0c00e4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:41.682724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b84072-ce0d-4176-85b0-599f0c00e4cb None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:41.687380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:41.688911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:41.689201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:41.689472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] PATH_INFO: `/v3/projects/2dcd09392e4e4260b429505db1252658` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:41.690746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dcd09392e4e4260b429505db1252658)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:41.692675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:41.704504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:41.840000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dcd09392e4e4260b429505db1252658', 'request_id': 'req-85dea470-bdd2-43c2-a0ab-9273dfd31e74'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:41.845394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dcd09392e4e4260b429505db1252658', 'request_id': 'req-85dea470-bdd2-43c2-a0ab-9273dfd31e74'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:41.942254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dcd09392e4e4260b429505db1252658', 'request_id': 'req-85dea470-bdd2-43c2-a0ab-9273dfd31e74'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:41.953737 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] The token cache is being invalidate because project 2dcd09392e4e4260b429505db1252658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:41.954022 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:41.954696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:41.956309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1268/2530] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:41 2022] DELETE /identity/v3/projects/2dcd09392e4e4260b429505db1252658 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:41.961032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9589-123a-4c4b-9b7b-5b9c3a498396 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:41.970900 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c9589-123a-4c4b-9b7b-5b9c3a498396 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:42.021230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:42.027891 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:42.028761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:42.029041 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:42.029313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] PATH_INFO: `/v3/users/9f1bd6d406504c83b1297e50d3068936` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:42.030481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f1bd6d406504c83b1297e50d3068936)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:42.032435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:42.202980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f1bd6d406504c83b1297e50d3068936'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:42.203548 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f1bd6d406504c83b1297e50d3068936'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:42.204192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f1bd6d406504c83b1297e50d3068936'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:42.216789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f1bd6d406504c83b1297e50d3068936'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:42.223627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-728ffccb-4371-4385-bd20-43e2ce98b264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f1bd6d406504c83b1297e50d3068936'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:42.296525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1263/2531] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:41 2022] DELETE /identity/v3/users/9f1bd6d406504c83b1297e50d3068936 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:42.688650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:42.690164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:42.706275 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dea470-bdd2-43c2-a0ab-9273dfd31e74 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:42.765660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:42.766462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:42.766785 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:42.767058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] PATH_INFO: `/v3/projects/19f486a9babf466cbd072e0ffcd9d7ce` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:42.768217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f486a9babf466cbd072e0ffcd9d7ce)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:42.770258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:42.916092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f486a9babf466cbd072e0ffcd9d7ce', 'request_id': 'req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:42.921670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f486a9babf466cbd072e0ffcd9d7ce', 'request_id': 'req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:43.030124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f486a9babf466cbd072e0ffcd9d7ce', 'request_id': 'req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:43.043051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] The token cache is being invalidate because project 19f486a9babf466cbd072e0ffcd9d7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:43.043340 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:43.043970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-9ed6fefc-d45e-4fd7-8f08-78fb1596c9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:43.045510 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1269/2532] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:42 2022] DELETE /identity/v3/projects/19f486a9babf466cbd072e0ffcd9d7ce => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:43.050447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ee22-34eb-4f0c-b11c-207dfdfce58d None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.051793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ee22-34eb-4f0c-b11c-207dfdfce58d None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.051977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385ee22-34eb-4f0c-b11c-207dfdfce58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.069600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9385ee22-34eb-4f0c-b11c-207dfdfce58d None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:43.070817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9385ee22-34eb-4f0c-b11c-207dfdfce58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:43.129094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1264/2533] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:43.136946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c562-f455-4b6a-86c4-dbbcbaa2344b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.137371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c562-f455-4b6a-86c4-dbbcbaa2344b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.137659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571c562-f455-4b6a-86c4-dbbcbaa2344b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.155422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-8571c562-f455-4b6a-86c4-dbbcbaa2344b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:43.156628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8571c562-f455-4b6a-86c4-dbbcbaa2344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:43.165204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1270/2534] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:43.169384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ee22-34eb-4f0c-b11c-207dfdfce58d None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.179488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385ee22-34eb-4f0c-b11c-207dfdfce58d None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:43.183982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:43.184713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.184992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.185264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.186096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:55:43.186402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:43.188014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:43.199719 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1265/2535] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:55:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:55:43.204391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c562-f455-4b6a-86c4-dbbcbaa2344b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.214245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571c562-f455-4b6a-86c4-dbbcbaa2344b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:43.218959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2dc81-7b76-4381-b3ef-d8ebf37afb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:43.219610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2dc81-7b76-4381-b3ef-d8ebf37afb7b admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.219894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2dc81-7b76-4381-b3ef-d8ebf37afb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.220173 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2dc81-7b76-4381-b3ef-d8ebf37afb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.220866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2dc81-7b76-4381-b3ef-d8ebf37afb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:43.223515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f2dc81-7b76-4381-b3ef-d8ebf37afb7b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:43.310414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1271/2536] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:55:43 2022] POST /identity/v3/projects => generated 401 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:43.314422 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.324433 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be2223-ee49-4cc9-9bd7-f397969a6e17 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:43.382664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853978b5-dd5d-4cb6-b467-61705d7b07b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:43.383344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853978b5-dd5d-4cb6-b467-61705d7b07b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.386223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853978b5-dd5d-4cb6-b467-61705d7b07b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.386223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853978b5-dd5d-4cb6-b467-61705d7b07b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.386223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853978b5-dd5d-4cb6-b467-61705d7b07b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:43.386638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853978b5-dd5d-4cb6-b467-61705d7b07b6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:43.394035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:43.469530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1266/2537] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:55:43 2022] POST /identity/v3/users => generated 301 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:43.474290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2dc81-7b76-4381-b3ef-d8ebf37afb7b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.479816 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:43.485199 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f2dc81-7b76-4381-b3ef-d8ebf37afb7b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:43.489930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7f018-f3e4-4099-84aa-a84cd73eb609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:43.490627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7f018-f3e4-4099-84aa-a84cd73eb609 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.490915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7f018-f3e4-4099-84aa-a84cd73eb609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.491192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7f018-f3e4-4099-84aa-a84cd73eb609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.491945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7f018-f3e4-4099-84aa-a84cd73eb609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:43.493571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df7f018-f3e4-4099-84aa-a84cd73eb609 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:43.503551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1272/2538] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:43.507690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853978b5-dd5d-4cb6-b467-61705d7b07b6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.517640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853978b5-dd5d-4cb6-b467-61705d7b07b6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:43.523297 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c132a97f-3c1c-40bd-92ee-24e8315094d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:43.523980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a97f-3c1c-40bd-92ee-24e8315094d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.524264 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a97f-3c1c-40bd-92ee-24e8315094d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.524542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c132a97f-3c1c-40bd-92ee-24e8315094d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.525263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132a97f-3c1c-40bd-92ee-24e8315094d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:43.526875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c132a97f-3c1c-40bd-92ee-24e8315094d5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:43.538627 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1267/2539] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:43.542434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7f018-f3e4-4099-84aa-a84cd73eb609 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.568493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7f018-f3e4-4099-84aa-a84cd73eb609 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:43.568493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb76ba-f5f8-43c0-8c42-b9eb633bd03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:43.568493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb76ba-f5f8-43c0-8c42-b9eb633bd03d admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.568493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb76ba-f5f8-43c0-8c42-b9eb633bd03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.568931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb76ba-f5f8-43c0-8c42-b9eb633bd03d admin admin] PATH_INFO: `/v3/projects/ca89969ca1184a6c8a2f9eb2dc868dea/users/767ab961dc174b638512382f805f2541/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.575224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb76ba-f5f8-43c0-8c42-b9eb633bd03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca89969ca1184a6c8a2f9eb2dc868dea, user_id=767ab961dc174b638512382f805f2541, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:43.577840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acb76ba-f5f8-43c0-8c42-b9eb633bd03d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:43.658914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1273/2540] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:43 2022] PUT /identity/v3/projects/ca89969ca1184a6c8a2f9eb2dc868dea/users/767ab961dc174b638512382f805f2541/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:43.670394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80d33-6389-4157-8461-fddbffe55afd None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.670857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80d33-6389-4157-8461-fddbffe55afd None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.671136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac80d33-6389-4157-8461-fddbffe55afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.697915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cac80d33-6389-4157-8461-fddbffe55afd None None] MFA Rules not processed for user `767ab961dc174b638512382f805f2541`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:43.699164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cac80d33-6389-4157-8461-fddbffe55afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:43.765058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1268/2541] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:43.770161 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb76ba-f5f8-43c0-8c42-b9eb633bd03d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.829807 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb76ba-f5f8-43c0-8c42-b9eb633bd03d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:43.835059 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ee4a3-64e6-49ef-9e09-7477dfbbc4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:43.835709 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ee4a3-64e6-49ef-9e09-7477dfbbc4f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:43.835988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ee4a3-64e6-49ef-9e09-7477dfbbc4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:43.836262 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ee4a3-64e6-49ef-9e09-7477dfbbc4f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:43.836955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ee4a3-64e6-49ef-9e09-7477dfbbc4f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:43.838941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ee4a3-64e6-49ef-9e09-7477dfbbc4f7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:43.983678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1274/2542] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:55:43 2022] POST /identity/v3/projects => generated 401 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:43.987805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac80d33-6389-4157-8461-fddbffe55afd None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:43.999471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac80d33-6389-4157-8461-fddbffe55afd None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:44.056402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9e1a0-0c9d-46e8-a99c-9a7819869ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:44.057064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9e1a0-0c9d-46e8-a99c-9a7819869ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:44.057341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9e1a0-0c9d-46e8-a99c-9a7819869ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:44.057618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb9e1a0-0c9d-46e8-a99c-9a7819869ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:44.058313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9e1a0-0c9d-46e8-a99c-9a7819869ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:44.060293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb9e1a0-0c9d-46e8-a99c-9a7819869ac1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:44.138762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1269/2543] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:55:43 2022] POST /identity/v3/users => generated 307 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:44.142744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ee4a3-64e6-49ef-9e09-7477dfbbc4f7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:44.152982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ee4a3-64e6-49ef-9e09-7477dfbbc4f7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:44.157533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034feb44-7cf2-443d-bf20-3e2711362eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:44.158190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034feb44-7cf2-443d-bf20-3e2711362eee admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:44.158465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034feb44-7cf2-443d-bf20-3e2711362eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:44.158770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034feb44-7cf2-443d-bf20-3e2711362eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:44.159486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034feb44-7cf2-443d-bf20-3e2711362eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:44.164428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034feb44-7cf2-443d-bf20-3e2711362eee admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:44.171665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1275/2544] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:44.176227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9e1a0-0c9d-46e8-a99c-9a7819869ac1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:44.186205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb9e1a0-0c9d-46e8-a99c-9a7819869ac1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:44.190777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26365b7c-4568-4118-88bc-6210b9077c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:44.192438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26365b7c-4568-4118-88bc-6210b9077c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:44.192721 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26365b7c-4568-4118-88bc-6210b9077c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:44.192995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26365b7c-4568-4118-88bc-6210b9077c8d admin admin] PATH_INFO: `/v3/projects/25239c23ff4847cbb09a70f07563cb98/users/8070182266f54ecf8fd8a21a7c51e2d8/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:44.207428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26365b7c-4568-4118-88bc-6210b9077c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25239c23ff4847cbb09a70f07563cb98, user_id=8070182266f54ecf8fd8a21a7c51e2d8, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:44.210209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26365b7c-4568-4118-88bc-6210b9077c8d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:44.291524 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1270/2545] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:44 2022] PUT /identity/v3/projects/25239c23ff4847cbb09a70f07563cb98/users/8070182266f54ecf8fd8a21a7c51e2d8/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:44.295456 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034feb44-7cf2-443d-bf20-3e2711362eee admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:44.305832 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034feb44-7cf2-443d-bf20-3e2711362eee admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:44.362445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47531922-b521-4cfc-b7ed-ee314b30e1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:44.364061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531922-b521-4cfc-b7ed-ee314b30e1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:44.364061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531922-b521-4cfc-b7ed-ee314b30e1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:44.364350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531922-b521-4cfc-b7ed-ee314b30e1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:44.364911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47531922-b521-4cfc-b7ed-ee314b30e1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:44.366496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47531922-b521-4cfc-b7ed-ee314b30e1ad admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:44.376366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1276/2546] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:44.381346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26365b7c-4568-4118-88bc-6210b9077c8d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:44.396194 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26365b7c-4568-4118-88bc-6210b9077c8d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:44.396970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:44.397868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:44.398143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:44.398440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] PATH_INFO: `/v3/projects/25239c23ff4847cbb09a70f07563cb98/users/8070182266f54ecf8fd8a21a7c51e2d8/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:44.400501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] RBAC: Authorizing `identity:create_grant(project_id=25239c23ff4847cbb09a70f07563cb98, user_id=8070182266f54ecf8fd8a21a7c51e2d8, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:44.403213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:44.414179 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1271/2547] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:44 2022] PUT /identity/v3/projects/25239c23ff4847cbb09a70f07563cb98/users/8070182266f54ecf8fd8a21a7c51e2d8/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:44.424097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534054b2-dc73-48b2-8e63-78c0a38d59dd None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:44.424380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534054b2-dc73-48b2-8e63-78c0a38d59dd None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:44.424655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534054b2-dc73-48b2-8e63-78c0a38d59dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:44.451290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-534054b2-dc73-48b2-8e63-78c0a38d59dd None None] MFA Rules not processed for user `8070182266f54ecf8fd8a21a7c51e2d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:44.452473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-534054b2-dc73-48b2-8e63-78c0a38d59dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:44.480369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:44.523109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1277/2548] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:44.533696 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:44.536097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:44.562293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:44.592607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3520c-33bf-481a-8b0d-9cb89a5ad85c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:44.596756 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff56a9-9ad3-49c6-966c-ad46266d66e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:44.597944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff56a9-9ad3-49c6-966c-ad46266d66e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:44.598259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff56a9-9ad3-49c6-966c-ad46266d66e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:44.598550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff56a9-9ad3-49c6-966c-ad46266d66e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:44.607418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff56a9-9ad3-49c6-966c-ad46266d66e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:44.608837 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff56a9-9ad3-49c6-966c-ad46266d66e4 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:44.618835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1272/2549] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:44 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:44.835445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534054b2-dc73-48b2-8e63-78c0a38d59dd None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:44.845181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534054b2-dc73-48b2-8e63-78c0a38d59dd None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:44.849606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a7fc6-7a51-44d2-8946-340e04fd5227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:44.850278 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7fc6-7a51-44d2-8946-340e04fd5227 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:44.850589 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7fc6-7a51-44d2-8946-340e04fd5227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:44.850866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7fc6-7a51-44d2-8946-340e04fd5227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:44.907459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a7fc6-7a51-44d2-8946-340e04fd5227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:44.908899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a7fc6-7a51-44d2-8946-340e04fd5227 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:44.918862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1278/2550] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:51.312615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff56a9-9ad3-49c6-966c-ad46266d66e4 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:51.376574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff56a9-9ad3-49c6-966c-ad46266d66e4 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:51.381697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:51.382601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:51.382915 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:51.383187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] PATH_INFO: `/v3/users/767ab961dc174b638512382f805f2541` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:51.384360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=767ab961dc174b638512382f805f2541)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:51.386270 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:51.612137 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '767ab961dc174b638512382f805f2541'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:51.612734 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '767ab961dc174b638512382f805f2541'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:51.613386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '767ab961dc174b638512382f805f2541'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:51.626145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '767ab961dc174b638512382f805f2541'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:51.633623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '767ab961dc174b638512382f805f2541'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:51.725098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1273/2551] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:51 2022] DELETE /identity/v3/users/767ab961dc174b638512382f805f2541 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:51.729507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611363a-4693-404a-9159-4f7cb9505ffd None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:51.729967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611363a-4693-404a-9159-4f7cb9505ffd None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:51.730063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5611363a-4693-404a-9159-4f7cb9505ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:51.747371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5611363a-4693-404a-9159-4f7cb9505ffd None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:51.748568 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5611363a-4693-404a-9159-4f7cb9505ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:51.807442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1279/2552] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:51.817199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:51.819752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:51.867540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:51.877929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420fe1d6-5d23-4f63-af1b-c2cfb4d21f61 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:51.881583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3d3c7-72cd-438f-a30d-a13de7a7b4f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:51.882223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3d3c7-72cd-438f-a30d-a13de7a7b4f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:51.882501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3d3c7-72cd-438f-a30d-a13de7a7b4f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:51.882808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec3d3c7-72cd-438f-a30d-a13de7a7b4f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:51.891584 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3d3c7-72cd-438f-a30d-a13de7a7b4f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:51.892990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec3d3c7-72cd-438f-a30d-a13de7a7b4f2 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:51.903002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1274/2553] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:52.304219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611363a-4693-404a-9159-4f7cb9505ffd None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:52.305930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5611363a-4693-404a-9159-4f7cb9505ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:52.320032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5611363a-4693-404a-9159-4f7cb9505ffd None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:52.324727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:52.325595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:52.325872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:52.326140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] PATH_INFO: `/v3/projects/ca89969ca1184a6c8a2f9eb2dc868dea` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:52.327402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca89969ca1184a6c8a2f9eb2dc868dea)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:52.329489 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:52.602790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca89969ca1184a6c8a2f9eb2dc868dea', 'request_id': 'req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.607488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:52.609366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca89969ca1184a6c8a2f9eb2dc868dea', 'request_id': 'req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.698337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca89969ca1184a6c8a2f9eb2dc868dea', 'request_id': 'req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.711104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] The token cache is being invalidate because project ca89969ca1184a6c8a2f9eb2dc868dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:52.713935 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.713935 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.713935 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1280/2554] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:52 2022] DELETE /identity/v3/projects/ca89969ca1184a6c8a2f9eb2dc868dea => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:55:52.717750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3d3c7-72cd-438f-a30d-a13de7a7b4f2 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:52.727501 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec3d3c7-72cd-438f-a30d-a13de7a7b4f2 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:52.782910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:52.783783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:52.784062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:52.784336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] PATH_INFO: `/v3/users/8070182266f54ecf8fd8a21a7c51e2d8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:52.785500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8070182266f54ecf8fd8a21a7c51e2d8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:52.787882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:52.947748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8070182266f54ecf8fd8a21a7c51e2d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.948460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8070182266f54ecf8fd8a21a7c51e2d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.949028 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8070182266f54ecf8fd8a21a7c51e2d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.961290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8070182266f54ecf8fd8a21a7c51e2d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:52.968156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-acb58586-4e32-4447-876a-9b85b3f05043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8070182266f54ecf8fd8a21a7c51e2d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:53.056517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1275/2555] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:55:52 2022] DELETE /identity/v3/users/8070182266f54ecf8fd8a21a7c51e2d8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:53.562139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:53.563595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:53.576742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ac316-42c7-4d48-b3d8-efcbdf8075b9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:53.636221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:53.637115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:53.637397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:53.637671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] PATH_INFO: `/v3/projects/25239c23ff4847cbb09a70f07563cb98` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:53.638880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25239c23ff4847cbb09a70f07563cb98)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:53.641254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:53.761617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25239c23ff4847cbb09a70f07563cb98', 'request_id': 'req-e71ff9e7-9c57-4501-92de-6b9c895e4e85'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:53.767023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25239c23ff4847cbb09a70f07563cb98', 'request_id': 'req-e71ff9e7-9c57-4501-92de-6b9c895e4e85'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:53.846833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25239c23ff4847cbb09a70f07563cb98', 'request_id': 'req-e71ff9e7-9c57-4501-92de-6b9c895e4e85'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:53.858818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] The token cache is being invalidate because project 25239c23ff4847cbb09a70f07563cb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:55:53.859118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:53.859742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e71ff9e7-9c57-4501-92de-6b9c895e4e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:55:53.861353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1281/2556] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:55:53 2022] DELETE /identity/v3/projects/25239c23ff4847cbb09a70f07563cb98 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:53.866251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edafed-2984-4323-8996-377bb7e71772 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:53.866778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edafed-2984-4323-8996-377bb7e71772 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:53.866876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edafed-2984-4323-8996-377bb7e71772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:53.885125 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-89edafed-2984-4323-8996-377bb7e71772 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:53.886351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-89edafed-2984-4323-8996-377bb7e71772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:53.944091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1276/2557] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:53.951648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eedf56-4ae9-4d76-b50e-9350625547cc None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:53.952107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eedf56-4ae9-4d76-b50e-9350625547cc None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:53.952389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eedf56-4ae9-4d76-b50e-9350625547cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:53.973474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-26eedf56-4ae9-4d76-b50e-9350625547cc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:53.975767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-26eedf56-4ae9-4d76-b50e-9350625547cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:53.985053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1282/2558] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:53.989352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edafed-2984-4323-8996-377bb7e71772 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:53.999450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edafed-2984-4323-8996-377bb7e71772 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:54.004320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:54.005030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.005888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.006170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.006933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:55:54.007241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:54.008893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:54.010479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:54.022336 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1277/2559] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:55:54.026696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eedf56-4ae9-4d76-b50e-9350625547cc None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:54.036051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eedf56-4ae9-4d76-b50e-9350625547cc None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:54.041483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172d615-b427-4e82-bdc2-64fc2fcb3528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:54.042139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172d615-b427-4e82-bdc2-64fc2fcb3528 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.042416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172d615-b427-4e82-bdc2-64fc2fcb3528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.042749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172d615-b427-4e82-bdc2-64fc2fcb3528 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.043461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172d615-b427-4e82-bdc2-64fc2fcb3528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:54.045365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172d615-b427-4e82-bdc2-64fc2fcb3528 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:54.145125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1283/2560] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:55:54 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:54.149967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:54.160292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4a99a-dc92-4a79-9232-d3ce0a01588d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:54.215697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e9c1c-df95-4f87-81e7-83ba0c1f580c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:54.216375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e9c1c-df95-4f87-81e7-83ba0c1f580c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.216657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e9c1c-df95-4f87-81e7-83ba0c1f580c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.216929 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79e9c1c-df95-4f87-81e7-83ba0c1f580c admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.217618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e9c1c-df95-4f87-81e7-83ba0c1f580c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:54.219603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79e9c1c-df95-4f87-81e7-83ba0c1f580c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:54.310293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1278/2561] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:55:54 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:55:54.314567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172d615-b427-4e82-bdc2-64fc2fcb3528 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:54.327204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172d615-b427-4e82-bdc2-64fc2fcb3528 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:54.333115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf827c-3f71-4b5a-a8f6-5b4a597c0886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:54.334626 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf827c-3f71-4b5a-a8f6-5b4a597c0886 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.334963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf827c-3f71-4b5a-a8f6-5b4a597c0886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.335236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf827c-3f71-4b5a-a8f6-5b4a597c0886 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.336027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf827c-3f71-4b5a-a8f6-5b4a597c0886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:54.337642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf827c-3f71-4b5a-a8f6-5b4a597c0886 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:54.350792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1284/2562] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:54.354838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e9c1c-df95-4f87-81e7-83ba0c1f580c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:54.365399 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79e9c1c-df95-4f87-81e7-83ba0c1f580c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:54.369979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1a558-322b-41c3-911c-64cccb25827f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:54.370675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a558-322b-41c3-911c-64cccb25827f admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.370957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a558-322b-41c3-911c-64cccb25827f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.371233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1a558-322b-41c3-911c-64cccb25827f admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.371950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1a558-322b-41c3-911c-64cccb25827f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:54.373814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1a558-322b-41c3-911c-64cccb25827f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:54.384542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1279/2563] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:54.388575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf827c-3f71-4b5a-a8f6-5b4a597c0886 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:54.399327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf827c-3f71-4b5a-a8f6-5b4a597c0886 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:54.403767 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa34e48-4065-4385-a507-394d6a913a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:54.404632 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa34e48-4065-4385-a507-394d6a913a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.404911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa34e48-4065-4385-a507-394d6a913a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.405211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa34e48-4065-4385-a507-394d6a913a2f admin admin] PATH_INFO: `/v3/projects/db44147ec01e4fd78757e4e38d6b38f5/users/41b3de78400f426bb26d510c018b6145/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.419531 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa34e48-4065-4385-a507-394d6a913a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=db44147ec01e4fd78757e4e38d6b38f5, user_id=41b3de78400f426bb26d510c018b6145, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:54.422185 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa34e48-4065-4385-a507-394d6a913a2f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:54.503572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1285/2564] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:54 2022] PUT /identity/v3/projects/db44147ec01e4fd78757e4e38d6b38f5/users/41b3de78400f426bb26d510c018b6145/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:54.509556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f1f6e-8ac3-46f3-92fa-b8fee06fbb5b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.509845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f1f6e-8ac3-46f3-92fa-b8fee06fbb5b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.510121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f1f6e-8ac3-46f3-92fa-b8fee06fbb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.536962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-946f1f6e-8ac3-46f3-92fa-b8fee06fbb5b None None] MFA Rules not processed for user `41b3de78400f426bb26d510c018b6145`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:54.538190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-946f1f6e-8ac3-46f3-92fa-b8fee06fbb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:54.602227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1280/2565] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:54.606819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa34e48-4065-4385-a507-394d6a913a2f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:54.620254 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:54.679619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa34e48-4065-4385-a507-394d6a913a2f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:54.684157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425b31-50d1-4979-94be-7e1e5bc1bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:54.684819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425b31-50d1-4979-94be-7e1e5bc1bf56 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.685099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425b31-50d1-4979-94be-7e1e5bc1bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.685373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53425b31-50d1-4979-94be-7e1e5bc1bf56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.686058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53425b31-50d1-4979-94be-7e1e5bc1bf56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:54.687975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53425b31-50d1-4979-94be-7e1e5bc1bf56 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:54.806722 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1286/2566] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:55:54 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:54.810941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f1f6e-8ac3-46f3-92fa-b8fee06fbb5b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:54.821688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f1f6e-8ac3-46f3-92fa-b8fee06fbb5b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:54.878082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd6ea-65ad-4f00-b80a-0bc6b320dd91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:54.878799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd6ea-65ad-4f00-b80a-0bc6b320dd91 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:54.879061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd6ea-65ad-4f00-b80a-0bc6b320dd91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:54.879331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21edd6ea-65ad-4f00-b80a-0bc6b320dd91 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:54.880106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd6ea-65ad-4f00-b80a-0bc6b320dd91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:54.882052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21edd6ea-65ad-4f00-b80a-0bc6b320dd91 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:54.889618 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:55.023059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1281/2567] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:55:54 2022] POST /identity/v3/users => generated 298 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:55:55.028206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425b31-50d1-4979-94be-7e1e5bc1bf56 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:55.041983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53425b31-50d1-4979-94be-7e1e5bc1bf56 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:55.046622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020e61b-e3d2-4e5d-bcc8-b6c48140ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:55.049118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020e61b-e3d2-4e5d-bcc8-b6c48140ba51 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:55.049118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020e61b-e3d2-4e5d-bcc8-b6c48140ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:55.049118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8020e61b-e3d2-4e5d-bcc8-b6c48140ba51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:55.049118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020e61b-e3d2-4e5d-bcc8-b6c48140ba51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:55.050343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8020e61b-e3d2-4e5d-bcc8-b6c48140ba51 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:55.062174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1287/2568] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:55.066301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd6ea-65ad-4f00-b80a-0bc6b320dd91 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:55.077111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21edd6ea-65ad-4f00-b80a-0bc6b320dd91 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:55.081660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3839bb2-60fe-4825-9ed4-8add2f3f932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:55.082552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839bb2-60fe-4825-9ed4-8add2f3f932d admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:55.082918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839bb2-60fe-4825-9ed4-8add2f3f932d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:55.083190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3839bb2-60fe-4825-9ed4-8add2f3f932d admin admin] PATH_INFO: `/v3/projects/4b851689ea1e47ddb3ffaae90b6919ff/users/04fe17635941452eab0920ef043f13d8/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:55.097530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3839bb2-60fe-4825-9ed4-8add2f3f932d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b851689ea1e47ddb3ffaae90b6919ff, user_id=04fe17635941452eab0920ef043f13d8, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:55.100724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3839bb2-60fe-4825-9ed4-8add2f3f932d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:55.184521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1282/2569] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:55 2022] PUT /identity/v3/projects/4b851689ea1e47ddb3ffaae90b6919ff/users/04fe17635941452eab0920ef043f13d8/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:55.188512 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020e61b-e3d2-4e5d-bcc8-b6c48140ba51 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:55.198894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8020e61b-e3d2-4e5d-bcc8-b6c48140ba51 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:55.255075 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765cc35-990a-4361-a37e-b51a527ced6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:55.255951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765cc35-990a-4361-a37e-b51a527ced6d admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:55.256263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765cc35-990a-4361-a37e-b51a527ced6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:55.256537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765cc35-990a-4361-a37e-b51a527ced6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:55.257253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765cc35-990a-4361-a37e-b51a527ced6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:55.258879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765cc35-990a-4361-a37e-b51a527ced6d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:55.268806 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1288/2570] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:55:55.273592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3839bb2-60fe-4825-9ed4-8add2f3f932d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:55.284201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3839bb2-60fe-4825-9ed4-8add2f3f932d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:55.289607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:55.290492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:55.290809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:55.291101 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] PATH_INFO: `/v3/projects/4b851689ea1e47ddb3ffaae90b6919ff/users/04fe17635941452eab0920ef043f13d8/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:55.293036 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b851689ea1e47ddb3ffaae90b6919ff, user_id=04fe17635941452eab0920ef043f13d8, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:55.295725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:55.306293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1283/2571] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:55:55 2022] PUT /identity/v3/projects/4b851689ea1e47ddb3ffaae90b6919ff/users/04fe17635941452eab0920ef043f13d8/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:55:55.316294 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d0fba-6e4a-44f4-97f8-2245e2c6460b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:55.316587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d0fba-6e4a-44f4-97f8-2245e2c6460b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:55.316894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d0fba-6e4a-44f4-97f8-2245e2c6460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:55.357302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-d23d0fba-6e4a-44f4-97f8-2245e2c6460b None None] MFA Rules not processed for user `04fe17635941452eab0920ef043f13d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:55:55.359120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d23d0fba-6e4a-44f4-97f8-2245e2c6460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:55.428248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1289/2572] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:55:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:55:55.438780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:55.440446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:55.500060 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672d4a2-5813-4e00-91c7-401ebf9842c6 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:55.503708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216bb2d-e7b8-40b2-a0ed-a366efed3ad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:55.504350 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216bb2d-e7b8-40b2-a0ed-a366efed3ad5 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:55.504633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216bb2d-e7b8-40b2-a0ed-a366efed3ad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:55.504911 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a216bb2d-e7b8-40b2-a0ed-a366efed3ad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:55.514252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216bb2d-e7b8-40b2-a0ed-a366efed3ad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:55.515705 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a216bb2d-e7b8-40b2-a0ed-a366efed3ad5 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:55.526003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1284/2573] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:55:55.624777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d0fba-6e4a-44f4-97f8-2245e2c6460b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:55:55.626190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d23d0fba-6e4a-44f4-97f8-2245e2c6460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:55:55.638756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d0fba-6e4a-44f4-97f8-2245e2c6460b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:55:55.642317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cd2ea-de55-4bf2-b6db-2faa7730bef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:55:55.642996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cd2ea-de55-4bf2-b6db-2faa7730bef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:55:55.643279 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cd2ea-de55-4bf2-b6db-2faa7730bef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:55:55.643552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cd2ea-de55-4bf2-b6db-2faa7730bef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:55:55.648353 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:55:55.707843 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cd2ea-de55-4bf2-b6db-2faa7730bef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:55:55.710104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011cd2ea-de55-4bf2-b6db-2faa7730bef0 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:55:55.719197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1290/2574] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:55:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:00.030774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216bb2d-e7b8-40b2-a0ed-a366efed3ad5 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:00.093498 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a216bb2d-e7b8-40b2-a0ed-a366efed3ad5 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:00.098313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:00.099256 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:00.099532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:00.099809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] PATH_INFO: `/v3/users/41b3de78400f426bb26d510c018b6145` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:00.101569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b3de78400f426bb26d510c018b6145)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:00.103741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:00.304811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b3de78400f426bb26d510c018b6145'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:00.305476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b3de78400f426bb26d510c018b6145'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:00.306096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b3de78400f426bb26d510c018b6145'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:00.314294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=4,keystone:SELECT=88,keystone:DELETE=8 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:00.319903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b3de78400f426bb26d510c018b6145'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:00.326747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b3de78400f426bb26d510c018b6145'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:00.435001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1285/2575] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:56:00 2022] DELETE /identity/v3/users/41b3de78400f426bb26d510c018b6145 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:00.444403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8fe8-3403-4782-a4f5-56f6072e6097 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:00.445066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8fe8-3403-4782-a4f5-56f6072e6097 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:00.445066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59e8fe8-3403-4782-a4f5-56f6072e6097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:00.462654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b59e8fe8-3403-4782-a4f5-56f6072e6097 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:00.463880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b59e8fe8-3403-4782-a4f5-56f6072e6097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:00.527485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1291/2576] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:00.541445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:00.541445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:00.595506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574a171-fdbf-45ca-8252-a7845871f8b8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:00.599111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dacc87-a66e-4b9d-9153-c49731dd8957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:00.599763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dacc87-a66e-4b9d-9153-c49731dd8957 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:00.600047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dacc87-a66e-4b9d-9153-c49731dd8957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:00.600504 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dacc87-a66e-4b9d-9153-c49731dd8957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:00.609490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dacc87-a66e-4b9d-9153-c49731dd8957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:00.611054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dacc87-a66e-4b9d-9153-c49731dd8957 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:00.621111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1286/2577] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:56:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:01.053567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e8fe8-3403-4782-a4f5-56f6072e6097 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:01.055007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b59e8fe8-3403-4782-a4f5-56f6072e6097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:01.068286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59e8fe8-3403-4782-a4f5-56f6072e6097 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:01.073147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:01.074133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:01.074410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:01.074712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] PATH_INFO: `/v3/projects/db44147ec01e4fd78757e4e38d6b38f5` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:01.075898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db44147ec01e4fd78757e4e38d6b38f5)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:01.077795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:01.241222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db44147ec01e4fd78757e4e38d6b38f5', 'request_id': 'req-994a1545-33f0-448e-86a6-08f37af1b9d9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.246897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db44147ec01e4fd78757e4e38d6b38f5', 'request_id': 'req-994a1545-33f0-448e-86a6-08f37af1b9d9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.315049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db44147ec01e4fd78757e4e38d6b38f5', 'request_id': 'req-994a1545-33f0-448e-86a6-08f37af1b9d9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.327305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] The token cache is being invalidate because project db44147ec01e4fd78757e4e38d6b38f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:56:01.327583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.328195 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.329745 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1292/2578] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:56:01 2022] DELETE /identity/v3/projects/db44147ec01e4fd78757e4e38d6b38f5 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:56:01.339525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dacc87-a66e-4b9d-9153-c49731dd8957 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:01.349344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dacc87-a66e-4b9d-9153-c49731dd8957 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:01.407022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:01.407898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:01.408176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:01.408453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] PATH_INFO: `/v3/users/04fe17635941452eab0920ef043f13d8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:01.409614 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fe17635941452eab0920ef043f13d8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:01.411540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:01.632694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fe17635941452eab0920ef043f13d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.633359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fe17635941452eab0920ef043f13d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.633950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fe17635941452eab0920ef043f13d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.645601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fe17635941452eab0920ef043f13d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.653590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e3f2e246-7480-4d8c-8206-aa78719c932a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fe17635941452eab0920ef043f13d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:01.755560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:01.760961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1287/2579] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:56:01 2022] DELETE /identity/v3/users/04fe17635941452eab0920ef043f13d8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:02.246039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:02.247584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:02.264171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a1545-33f0-448e-86a6-08f37af1b9d9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:02.293190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:02.324444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:02.325448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:02.325730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:02.326005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] PATH_INFO: `/v3/projects/4b851689ea1e47ddb3ffaae90b6919ff` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:02.327203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b851689ea1e47ddb3ffaae90b6919ff)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:02.329114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:02.433567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b851689ea1e47ddb3ffaae90b6919ff', 'request_id': 'req-e38d5115-68fe-462c-80f6-1b48063227a1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:02.439101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b851689ea1e47ddb3ffaae90b6919ff', 'request_id': 'req-e38d5115-68fe-462c-80f6-1b48063227a1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:02.503358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b851689ea1e47ddb3ffaae90b6919ff', 'request_id': 'req-e38d5115-68fe-462c-80f6-1b48063227a1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:02.515509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] The token cache is being invalidate because project 4b851689ea1e47ddb3ffaae90b6919ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:56:02.515790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:02.516413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-e38d5115-68fe-462c-80f6-1b48063227a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:02.517946 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1293/2580] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:56:02 2022] DELETE /identity/v3/projects/4b851689ea1e47ddb3ffaae90b6919ff => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:02.523529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6109-92eb-49ff-bcff-274a3a6c79b2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:02.524026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6109-92eb-49ff-bcff-274a3a6c79b2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:02.524121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a6109-92eb-49ff-bcff-274a3a6c79b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:02.542650 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3d1a6109-92eb-49ff-bcff-274a3a6c79b2 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:02.547319 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3d1a6109-92eb-49ff-bcff-274a3a6c79b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:02.602777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1288/2581] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:56:02.611683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207997d0-57bd-411d-98cb-2c2ee3eedf81 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:02.611974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207997d0-57bd-411d-98cb-2c2ee3eedf81 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:02.612253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207997d0-57bd-411d-98cb-2c2ee3eedf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:02.631150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-207997d0-57bd-411d-98cb-2c2ee3eedf81 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:02.633055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-207997d0-57bd-411d-98cb-2c2ee3eedf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:02.641060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1294/2582] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:02.645295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6109-92eb-49ff-bcff-274a3a6c79b2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:02.655414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a6109-92eb-49ff-bcff-274a3a6c79b2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:02.659943 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:02.660596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:02.660936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:02.661217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:02.661934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:56:02.662240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:02.664741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:02.676087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1289/2583] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:56:02.681141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207997d0-57bd-411d-98cb-2c2ee3eedf81 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:02.690103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207997d0-57bd-411d-98cb-2c2ee3eedf81 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:02.694774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf143ae-2f16-4144-823a-7585b0579553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:02.695416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf143ae-2f16-4144-823a-7585b0579553 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:02.695694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf143ae-2f16-4144-823a-7585b0579553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:02.695964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf143ae-2f16-4144-823a-7585b0579553 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:02.696648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf143ae-2f16-4144-823a-7585b0579553 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:02.698548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf143ae-2f16-4144-823a-7585b0579553 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:02.824903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1295/2584] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:56:02 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:56:02.829216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:02.839167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fcb9ed-bbe8-4481-825f-4b9735f23efa admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:02.895643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671ade4-af71-4d48-91c2-f589372de9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:02.896317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671ade4-af71-4d48-91c2-f589372de9ca admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:02.896598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671ade4-af71-4d48-91c2-f589372de9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:02.896893 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671ade4-af71-4d48-91c2-f589372de9ca admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:02.897713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671ade4-af71-4d48-91c2-f589372de9ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:02.899685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671ade4-af71-4d48-91c2-f589372de9ca admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.018035 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1290/2585] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:56:02 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:56:03.022681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf143ae-2f16-4144-823a-7585b0579553 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.033153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf143ae-2f16-4144-823a-7585b0579553 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.038562 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fff53-996f-4cd9-a881-ea939dac5e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.039350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fff53-996f-4cd9-a881-ea939dac5e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.039696 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fff53-996f-4cd9-a881-ea939dac5e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.039977 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68fff53-996f-4cd9-a881-ea939dac5e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.040731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fff53-996f-4cd9-a881-ea939dac5e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.042747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68fff53-996f-4cd9-a881-ea939dac5e7c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.055002 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1296/2586] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:56:03.059164 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671ade4-af71-4d48-91c2-f589372de9ca admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.069446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671ade4-af71-4d48-91c2-f589372de9ca admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.074083 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd72b6d-3200-46b1-9aa2-0eb403212919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.074786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd72b6d-3200-46b1-9aa2-0eb403212919 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.075119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd72b6d-3200-46b1-9aa2-0eb403212919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.075346 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd72b6d-3200-46b1-9aa2-0eb403212919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.076063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd72b6d-3200-46b1-9aa2-0eb403212919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.077645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd72b6d-3200-46b1-9aa2-0eb403212919 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.089387 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1291/2587] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:56:03.093940 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fff53-996f-4cd9-a881-ea939dac5e7c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.109257 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68fff53-996f-4cd9-a881-ea939dac5e7c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.114083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528cb40-cb98-43d6-a4a5-49d1acf96863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.114991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528cb40-cb98-43d6-a4a5-49d1acf96863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.115270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528cb40-cb98-43d6-a4a5-49d1acf96863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.115546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3528cb40-cb98-43d6-a4a5-49d1acf96863 admin admin] PATH_INFO: `/v3/projects/660f692bff1b42fb92996832ee174ff0/users/e24ee63e0fc741f1916454fad8a24414/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.131108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528cb40-cb98-43d6-a4a5-49d1acf96863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=660f692bff1b42fb92996832ee174ff0, user_id=e24ee63e0fc741f1916454fad8a24414, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.133774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3528cb40-cb98-43d6-a4a5-49d1acf96863 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.207272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1297/2588] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:56:03 2022] PUT /identity/v3/projects/660f692bff1b42fb92996832ee174ff0/users/e24ee63e0fc741f1916454fad8a24414/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:03.222505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0a46-f662-412e-ad7e-3636aa162ebc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.222505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0a46-f662-412e-ad7e-3636aa162ebc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.222505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253f0a46-f662-412e-ad7e-3636aa162ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.246918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-253f0a46-f662-412e-ad7e-3636aa162ebc None None] MFA Rules not processed for user `e24ee63e0fc741f1916454fad8a24414`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:03.248121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-253f0a46-f662-412e-ad7e-3636aa162ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:03.305442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:03.315515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1292/2589] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:56:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:03.323296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528cb40-cb98-43d6-a4a5-49d1acf96863 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.383062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:03.388320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3528cb40-cb98-43d6-a4a5-49d1acf96863 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.393034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df44ad1-6d1b-4d1b-bee9-f54964695439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.393695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44ad1-6d1b-4d1b-bee9-f54964695439 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.393979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44ad1-6d1b-4d1b-bee9-f54964695439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.394256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df44ad1-6d1b-4d1b-bee9-f54964695439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.394979 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df44ad1-6d1b-4d1b-bee9-f54964695439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.396930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df44ad1-6d1b-4d1b-bee9-f54964695439 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.533672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1298/2590] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:56:03 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:56:03.538784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f0a46-f662-412e-ad7e-3636aa162ebc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.550366 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253f0a46-f662-412e-ad7e-3636aa162ebc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.606748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e492454-0c77-4c62-a771-cbf954d9233c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.607418 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492454-0c77-4c62-a771-cbf954d9233c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.607700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492454-0c77-4c62-a771-cbf954d9233c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.607976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e492454-0c77-4c62-a771-cbf954d9233c admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.608661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e492454-0c77-4c62-a771-cbf954d9233c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.610590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e492454-0c77-4c62-a771-cbf954d9233c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.707841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1293/2591] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:56:03 2022] POST /identity/v3/users => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:56:03.711836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df44ad1-6d1b-4d1b-bee9-f54964695439 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.722732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df44ad1-6d1b-4d1b-bee9-f54964695439 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.728116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbe53d-2294-4f10-944a-67599ad26676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.728896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbe53d-2294-4f10-944a-67599ad26676 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.729181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbe53d-2294-4f10-944a-67599ad26676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.729466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cbe53d-2294-4f10-944a-67599ad26676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.730192 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbe53d-2294-4f10-944a-67599ad26676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.731840 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cbe53d-2294-4f10-944a-67599ad26676 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.743092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1299/2592] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:56:03.747285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e492454-0c77-4c62-a771-cbf954d9233c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.758758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e492454-0c77-4c62-a771-cbf954d9233c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.763301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00184-c548-4d60-a597-84e6e67fb5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.764186 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00184-c548-4d60-a597-84e6e67fb5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.764856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00184-c548-4d60-a597-84e6e67fb5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.764856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d00184-c548-4d60-a597-84e6e67fb5e8 admin admin] PATH_INFO: `/v3/projects/5e84b7b1a5274fa4bf29f62f18a34ea0/users/dd281de88d254c4ba0ebaff2abad690a/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.781046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00184-c548-4d60-a597-84e6e67fb5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e84b7b1a5274fa4bf29f62f18a34ea0, user_id=dd281de88d254c4ba0ebaff2abad690a, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.783778 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d00184-c548-4d60-a597-84e6e67fb5e8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.869385 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1294/2593] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:56:03 2022] PUT /identity/v3/projects/5e84b7b1a5274fa4bf29f62f18a34ea0/users/dd281de88d254c4ba0ebaff2abad690a/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:03.873991 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbe53d-2294-4f10-944a-67599ad26676 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.884792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cbe53d-2294-4f10-944a-67599ad26676 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.943575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b9c5d9-2e4c-4d44-b402-84444f665183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.944351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9c5d9-2e4c-4d44-b402-84444f665183 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.944628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9c5d9-2e4c-4d44-b402-84444f665183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.944902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9c5d9-2e4c-4d44-b402-84444f665183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.945607 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9c5d9-2e4c-4d44-b402-84444f665183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.947223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b9c5d9-2e4c-4d44-b402-84444f665183 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.956810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1300/2594] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:56:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:56:03.962784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00184-c548-4d60-a597-84e6e67fb5e8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:03.972833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d00184-c548-4d60-a597-84e6e67fb5e8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:03.978286 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:03.979203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:03.979484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:03.979760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] PATH_INFO: `/v3/projects/5e84b7b1a5274fa4bf29f62f18a34ea0/users/dd281de88d254c4ba0ebaff2abad690a/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:03.981707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e84b7b1a5274fa4bf29f62f18a34ea0, user_id=dd281de88d254c4ba0ebaff2abad690a, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:03.984360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:03.994676 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1295/2595] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:56:03 2022] PUT /identity/v3/projects/5e84b7b1a5274fa4bf29f62f18a34ea0/users/dd281de88d254c4ba0ebaff2abad690a/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:04.005861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1710f-8def-4f84-ab3e-5c673d29b3c6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:04.006402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1710f-8def-4f84-ab3e-5c673d29b3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:04.006925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1710f-8def-4f84-ab3e-5c673d29b3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:04.034090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-bcb1710f-8def-4f84-ab3e-5c673d29b3c6 None None] MFA Rules not processed for user `dd281de88d254c4ba0ebaff2abad690a`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:04.035371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bcb1710f-8def-4f84-ab3e-5c673d29b3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:04.108788 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1301/2596] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:56:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:04.120084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:04.121765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:04.178990 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84168b1d-f5a6-4822-8045-46b3b1ab98bb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:04.182865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962f675-2954-4996-855f-d791206ca79b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:04.183523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f675-2954-4996-855f-d791206ca79b service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:04.183808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f675-2954-4996-855f-d791206ca79b service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:04.184086 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f675-2954-4996-855f-d791206ca79b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:04.193575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962f675-2954-4996-855f-d791206ca79b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:04.195896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962f675-2954-4996-855f-d791206ca79b service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:04.205518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1296/2597] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:56:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:04.338328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1710f-8def-4f84-ab3e-5c673d29b3c6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:04.349960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1710f-8def-4f84-ab3e-5c673d29b3c6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:04.354985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c14035-c896-4dcb-9c65-6b090347f799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:04.355742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c14035-c896-4dcb-9c65-6b090347f799 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:04.356087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c14035-c896-4dcb-9c65-6b090347f799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:04.356449 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c14035-c896-4dcb-9c65-6b090347f799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:04.412098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:04.422469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c14035-c896-4dcb-9c65-6b090347f799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:04.424043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c14035-c896-4dcb-9c65-6b090347f799 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:04.433852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1302/2598] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:56:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:04.945478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962f675-2954-4996-855f-d791206ca79b service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:05.000567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:05.014861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962f675-2954-4996-855f-d791206ca79b service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:05.019376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:05.020259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:05.020542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:05.020821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] PATH_INFO: `/v3/users/e24ee63e0fc741f1916454fad8a24414` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:05.022096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e24ee63e0fc741f1916454fad8a24414)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:05.024049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:05.217801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e24ee63e0fc741f1916454fad8a24414'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:05.218574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e24ee63e0fc741f1916454fad8a24414'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:05.219267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e24ee63e0fc741f1916454fad8a24414'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:05.237735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e24ee63e0fc741f1916454fad8a24414'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:05.267583 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e24ee63e0fc741f1916454fad8a24414'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:05.395629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1297/2599] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:56:04 2022] DELETE /identity/v3/users/e24ee63e0fc741f1916454fad8a24414 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:05.400367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d52a-c1bc-45f0-b29a-9f0089748eb1 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:05.404131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d52a-c1bc-45f0-b29a-9f0089748eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:05.404131 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d78d52a-c1bc-45f0-b29a-9f0089748eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:05.420153 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5d78d52a-c1bc-45f0-b29a-9f0089748eb1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:05.421372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5d78d52a-c1bc-45f0-b29a-9f0089748eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:05.496933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1303/2600] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:56:05.507591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:05.509027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:05.589710 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf190941-2541-4d2b-a43e-0c05f916e108 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:05.593588 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:05.594458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:05.599176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:05.599176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:05.604507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:05.605937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:05.616152 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1298/2601] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:05.669087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78d52a-c1bc-45f0-b29a-9f0089748eb1 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:05.670899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5d78d52a-c1bc-45f0-b29a-9f0089748eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:05.744733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d78d52a-c1bc-45f0-b29a-9f0089748eb1 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:05.750147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:05.750833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:05.751114 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:05.751384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:05.753220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:05.765925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:05.767550 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:05.779527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1304/2602] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:56:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:56:06.052221 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:06.054378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:06.070072 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73873d4-2323-440b-9e57-25d64e87cf70 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:06.075262 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:06.076204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:06.077080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:06.077080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] PATH_INFO: `/v3/projects/660f692bff1b42fb92996832ee174ff0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:06.078401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=660f692bff1b42fb92996832ee174ff0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:06.080673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:06.206811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660f692bff1b42fb92996832ee174ff0', 'request_id': 'req-82190124-87d9-4168-95a5-81d27efd4d2b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.213109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660f692bff1b42fb92996832ee174ff0', 'request_id': 'req-82190124-87d9-4168-95a5-81d27efd4d2b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.218503 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660f692bff1b42fb92996832ee174ff0', 'request_id': 'req-82190124-87d9-4168-95a5-81d27efd4d2b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.221416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:06.314378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] The token cache is being invalidate because project 660f692bff1b42fb92996832ee174ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:56:06.314626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.315257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.316806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1299/2603] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:56:06 2022] DELETE /identity/v3/projects/660f692bff1b42fb92996832ee174ff0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:06.321493 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:06.331895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3bf5e-dfc3-4753-816c-a1ae883d0159 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:06.389383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:06.390258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:06.390547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:06.390828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] PATH_INFO: `/v3/users/dd281de88d254c4ba0ebaff2abad690a` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:06.391993 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd281de88d254c4ba0ebaff2abad690a)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:06.393877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:06.415731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:06.634392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd281de88d254c4ba0ebaff2abad690a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.635335 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd281de88d254c4ba0ebaff2abad690a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.642741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd281de88d254c4ba0ebaff2abad690a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.656127 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd281de88d254c4ba0ebaff2abad690a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.656912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-15b802e4-038a-4bb5-9a7c-9c3594d81cad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd281de88d254c4ba0ebaff2abad690a'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:06.732248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1305/2604] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:56:06 2022] DELETE /identity/v3/users/dd281de88d254c4ba0ebaff2abad690a => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:07.221495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:07.223245 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:07.235970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82190124-87d9-4168-95a5-81d27efd4d2b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:07.298205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:07.299113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:07.299398 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:07.299672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] PATH_INFO: `/v3/projects/5e84b7b1a5274fa4bf29f62f18a34ea0` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:07.300848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e84b7b1a5274fa4bf29f62f18a34ea0)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:07.302760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:07.435193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e84b7b1a5274fa4bf29f62f18a34ea0', 'request_id': 'req-c13c78ae-9d5a-428d-be42-23e76b10ab53'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:07.441285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e84b7b1a5274fa4bf29f62f18a34ea0', 'request_id': 'req-c13c78ae-9d5a-428d-be42-23e76b10ab53'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:07.447936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e84b7b1a5274fa4bf29f62f18a34ea0', 'request_id': 'req-c13c78ae-9d5a-428d-be42-23e76b10ab53'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:07.520180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] The token cache is being invalidate because project 5e84b7b1a5274fa4bf29f62f18a34ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:56:07.520465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:07.521068 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:56:07.523510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1300/2605] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:56:07 2022] DELETE /identity/v3/projects/5e84b7b1a5274fa4bf29f62f18a34ea0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:56:11.047341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d8498-6a28-411a-8188-d42c73f182db None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:11.047824 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d8498-6a28-411a-8188-d42c73f182db None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:11.047923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d8498-6a28-411a-8188-d42c73f182db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:11.065762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-447d8498-6a28-411a-8188-d42c73f182db None None] MFA Rules not processed for user `98a275f65a3544a5b073fbf1ee10034b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:56:11.067003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-447d8498-6a28-411a-8188-d42c73f182db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:11.122822 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1306/2606] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:56:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:56:17.517527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=8,keystone:SELECT=53,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:21.115945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=7,keystone:SELECT=45,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:56:59.625519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:56:59.633265 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:59.688066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c78ae-9d5a-428d-be42-23e76b10ab53 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:56:59.691716 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:56:59.692912 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:56:59.693205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:56:59.693574 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:56:59.695380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:56:59.768663 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:56:59.770610 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:56:59.780133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1301/2607] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:07.175695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d8498-6a28-411a-8188-d42c73f182db None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:07.178123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-447d8498-6a28-411a-8188-d42c73f182db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:07.192970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d8498-6a28-411a-8188-d42c73f182db None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:07.197523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:07.198390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:07.198711 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:07.198986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] PATH_INFO: `/v3/users/160c6175803b45bf80591084ad4e92ba` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:07.200166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=160c6175803b45bf80591084ad4e92ba)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:07.202084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:07.381676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160c6175803b45bf80591084ad4e92ba'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:07.382334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160c6175803b45bf80591084ad4e92ba'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:07.389191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160c6175803b45bf80591084ad4e92ba'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:07.400821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160c6175803b45bf80591084ad4e92ba'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:07.401444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160c6175803b45bf80591084ad4e92ba'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:07.493655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1307/2608] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:57:07 2022] DELETE /identity/v3/users/160c6175803b45bf80591084ad4e92ba => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:57:07.798362 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:07.810472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c922b4e4-7d95-41b2-8708-9274e69a5a99 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:07.868616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:07.869479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:07.869759 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:07.870046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] PATH_INFO: `/v3/projects/d6cc833734e44b588c6d0d52c3ca7b84` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:07.871444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6cc833734e44b588c6d0d52c3ca7b84)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:07.873337 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:07.985761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6cc833734e44b588c6d0d52c3ca7b84', 'request_id': 'req-2108ba3b-be10-4995-a2af-7c2f01b4b033'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:07.987638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:07.993970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6cc833734e44b588c6d0d52c3ca7b84', 'request_id': 'req-2108ba3b-be10-4995-a2af-7c2f01b4b033'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.000342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6cc833734e44b588c6d0d52c3ca7b84', 'request_id': 'req-2108ba3b-be10-4995-a2af-7c2f01b4b033'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.143349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] The token cache is being invalidate because project d6cc833734e44b588c6d0d52c3ca7b84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:08.143651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.144278 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-2108ba3b-be10-4995-a2af-7c2f01b4b033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.146685 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1302/2609] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:57:07 2022] DELETE /identity/v3/projects/d6cc833734e44b588c6d0d52c3ca7b84 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:08.151053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:08.152482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:08.166358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52684c49-f334-469a-abb5-7b50dd6c99d0 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:08.227039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:08.227932 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:08.228350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:08.228633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] PATH_INFO: `/v3/users/4d7ff87a43e440d78fcc4caf18e26ab9` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:08.229839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7ff87a43e440d78fcc4caf18e26ab9)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:08.231808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:08.415175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7ff87a43e440d78fcc4caf18e26ab9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.415870 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7ff87a43e440d78fcc4caf18e26ab9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.423470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8a8e-f7b4-4c2e-9931-eca496b207b9 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:08.423765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8a8e-f7b4-4c2e-9931-eca496b207b9 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:08.424050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8a8e-f7b4-4c2e-9931-eca496b207b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:08.424210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7ff87a43e440d78fcc4caf18e26ab9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.440496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7ff87a43e440d78fcc4caf18e26ab9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.443679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7ff87a43e440d78fcc4caf18e26ab9'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.443679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:08.445870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-cd2e8a8e-f7b4-4c2e-9931-eca496b207b9 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:08.448373 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cd2e8a8e-f7b4-4c2e-9931-eca496b207b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:08.507187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1303/2610] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:57:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:57:08.518485 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1308/2611] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:57:08 2022] DELETE /identity/v3/users/4d7ff87a43e440d78fcc4caf18e26ab9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:08.632177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8a8e-f7b4-4c2e-9931-eca496b207b9 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:08.633630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cd2e8a8e-f7b4-4c2e-9931-eca496b207b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:08.704691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8a8e-f7b4-4c2e-9931-eca496b207b9 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:08.766157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817f5b2-2ee8-48ef-b5b9-9055005c73e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:08.766878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f5b2-2ee8-48ef-b5b9-9055005c73e4 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:08.767268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f5b2-2ee8-48ef-b5b9-9055005c73e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:08.767690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817f5b2-2ee8-48ef-b5b9-9055005c73e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:08.769368 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:08.770931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:08.799798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:08.830814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817f5b2-2ee8-48ef-b5b9-9055005c73e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:08.832413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817f5b2-2ee8-48ef-b5b9-9055005c73e4 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:08.841774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1304/2612] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:57:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:57:08.844930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021edc1e-6e5e-4698-af3b-a9252a8a1ab7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:08.850216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:08.851151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:08.851464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:08.851747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] PATH_INFO: `/v3/projects/8f7f589fa7b3458d80e8c907be67ac0a` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:08.853600 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7f589fa7b3458d80e8c907be67ac0a)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:08.855612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:08.966818 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7f589fa7b3458d80e8c907be67ac0a', 'request_id': 'req-0ca6f64d-1881-42d7-8a66-e9bb968b1907'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:08.974635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7f589fa7b3458d80e8c907be67ac0a', 'request_id': 'req-0ca6f64d-1881-42d7-8a66-e9bb968b1907'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:09.076678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7f589fa7b3458d80e8c907be67ac0a', 'request_id': 'req-0ca6f64d-1881-42d7-8a66-e9bb968b1907'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:09.095575 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] The token cache is being invalidate because project 8f7f589fa7b3458d80e8c907be67ac0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:57:09.095893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:09.096545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0ca6f64d-1881-42d7-8a66-e9bb968b1907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:57:09.099014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1309/2613] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:57:08 2022] DELETE /identity/v3/projects/8f7f589fa7b3458d80e8c907be67ac0a => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:57:18.958127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=14 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:19.092497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=53 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:26.101146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b485db-2adf-4d26-b0ba-9f45192be73f None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.101686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b485db-2adf-4d26-b0ba-9f45192be73f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.101686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b485db-2adf-4d26-b0ba-9f45192be73f None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.103123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1305/2614] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:57:26.112267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720ff6-210c-4bf1-805b-236971ef6e91 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.113299 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720ff6-210c-4bf1-805b-236971ef6e91 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.113299 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720ff6-210c-4bf1-805b-236971ef6e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.132763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9c720ff6-210c-4bf1-805b-236971ef6e91 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:26.134246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9c720ff6-210c-4bf1-805b-236971ef6e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:26.207111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1310/2615] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:26.219284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b485db-2adf-4d26-b0ba-9f45192be73f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.220972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b0b485db-2adf-4d26-b0ba-9f45192be73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:26.279056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b485db-2adf-4d26-b0ba-9f45192be73f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.282590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae553cf2-6ad8-47d9-b629-e52e62df847b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.283236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553cf2-6ad8-47d9-b629-e52e62df847b service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.283515 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553cf2-6ad8-47d9-b629-e52e62df847b service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.283788 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae553cf2-6ad8-47d9-b629-e52e62df847b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.294751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553cf2-6ad8-47d9-b629-e52e62df847b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.296183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae553cf2-6ad8-47d9-b629-e52e62df847b service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.307492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1306/2616] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:57:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:26.513900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed714f16-06a9-441b-a05d-cb53e1a0649b None None] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.514389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed714f16-06a9-441b-a05d-cb53e1a0649b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.514615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed714f16-06a9-441b-a05d-cb53e1a0649b None None] PATH_INFO: `/` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.515872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1311/2617] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:57:26.521066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a942-b93e-4745-8e4f-0dd8d7c90b60 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.521353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a942-b93e-4745-8e4f-0dd8d7c90b60 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.521629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658a942-b93e-4745-8e4f-0dd8d7c90b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.540170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6658a942-b93e-4745-8e4f-0dd8d7c90b60 None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:26.541279 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6658a942-b93e-4745-8e4f-0dd8d7c90b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:26.592589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1307/2618] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:26.605320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed714f16-06a9-441b-a05d-cb53e1a0649b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.607042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ed714f16-06a9-441b-a05d-cb53e1a0649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:26.621620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed714f16-06a9-441b-a05d-cb53e1a0649b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.625130 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f4b70-8fd8-4cf5-946c-085360f17eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.625763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4b70-8fd8-4cf5-946c-085360f17eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.630671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4b70-8fd8-4cf5-946c-085360f17eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.630671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f4b70-8fd8-4cf5-946c-085360f17eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.633763 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f4b70-8fd8-4cf5-946c-085360f17eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.635402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f4b70-8fd8-4cf5-946c-085360f17eb2 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.643253 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1312/2619] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:57:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:26.725905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9bc6e-1dc3-4750-a96f-68e12d86abd0 None None] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.726196 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9bc6e-1dc3-4750-a96f-68e12d86abd0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.726475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9bc6e-1dc3-4750-a96f-68e12d86abd0 None None] PATH_INFO: `/` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.727930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1308/2620] 10.222.0.60 () {54 vars in 921 bytes} [Thu May 26 12:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 12:57:26.733189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e565ec-b4b3-4d29-bdca-6ea079f69527 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.733478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e565ec-b4b3-4d29-bdca-6ea079f69527 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.733754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e565ec-b4b3-4d29-bdca-6ea079f69527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.752224 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-06e565ec-b4b3-4d29-bdca-6ea079f69527 None None] MFA Rules not processed for user `5643e9f777c94d06a2f5c687dd8919b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:26.753487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-06e565ec-b4b3-4d29-bdca-6ea079f69527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:26.763057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1313/2621] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 12:57:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:26.773802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9bc6e-1dc3-4750-a96f-68e12d86abd0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:26.785258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9bc6e-1dc3-4750-a96f-68e12d86abd0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:26.788806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:26.789429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:26.789709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:26.789981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:26.799988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:26.801331 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:26.811869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1309/2622] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:57:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:29.235812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65db90-772d-4482-b5e2-9e5654c1a30d None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:29.235812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65db90-772d-4482-b5e2-9e5654c1a30d None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:29.235812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65db90-772d-4482-b5e2-9e5654c1a30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:29.254181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-ab65db90-772d-4482-b5e2-9e5654c1a30d None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:29.255393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ab65db90-772d-4482-b5e2-9e5654c1a30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:29.310187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1314/2623] 10.222.0.60 () {58 vars in 1009 bytes} [Thu May 26 12:57:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:29.322562 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:29.323935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:29.405603 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdf712-46a0-4c76-b207-39f02971b8f8 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:29.411672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3c4f1-495f-4538-b914-64b5a0ba1d85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:29.412352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3c4f1-495f-4538-b914-64b5a0ba1d85 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:29.412632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3c4f1-495f-4538-b914-64b5a0ba1d85 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:29.412909 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f3c4f1-495f-4538-b914-64b5a0ba1d85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:29.421242 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3c4f1-495f-4538-b914-64b5a0ba1d85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:29.422878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f3c4f1-495f-4538-b914-64b5a0ba1d85 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:29.431058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1310/2624] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:57:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:57:34.632504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65db90-772d-4482-b5e2-9e5654c1a30d None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:34.633958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ab65db90-772d-4482-b5e2-9e5654c1a30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:34.645477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65db90-772d-4482-b5e2-9e5654c1a30d None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:34.649013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09877b-b958-4a97-a765-43bd95329338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:34.652573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09877b-b958-4a97-a765-43bd95329338 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:34.652573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09877b-b958-4a97-a765-43bd95329338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:34.652573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09877b-b958-4a97-a765-43bd95329338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:34.652573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ea09877b-b958-4a97-a765-43bd95329338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:34.666218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09877b-b958-4a97-a765-43bd95329338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:34.667672 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09877b-b958-4a97-a765-43bd95329338 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:34.679561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1315/2625] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:57:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:57:38.252827 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3c4f1-495f-4538-b914-64b5a0ba1d85 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:38.263715 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f3c4f1-495f-4538-b914-64b5a0ba1d85 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:38.267358 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:38.268008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:38.268290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:38.268563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:38.270706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:38.285307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:38.286751 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:38.297731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1311/2626] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:57:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:57:44.673667 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=71 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:48.292864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:57:50.028421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4da55-3f43-4616-93aa-24341ac91ab6 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:50.028904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4da55-3f43-4616-93aa-24341ac91ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:50.029014 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4da55-3f43-4616-93aa-24341ac91ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:50.046706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-c5c4da55-3f43-4616-93aa-24341ac91ab6 None None] MFA Rules not processed for user `709a912079c747838254b83f06568cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:57:50.047912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c5c4da55-3f43-4616-93aa-24341ac91ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:57:50.055658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1316/2627] 10.222.0.60 () {58 vars in 967 bytes} [Thu May 26 12:57:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:57:50.067645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:57:50.079886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a74f9-f044-44fd-b52f-ef903348e204 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:57:50.085042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df88788d6691436c983cdb53f5e4c53e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:57:50.085692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:57:50.085977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:57:50.086257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:57:50.094787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:57:50.096372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:57:50.104797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1312/2628] 10.222.0.60 () {60 vars in 1384 bytes} [Thu May 26 12:57:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 12:58:00.041440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:00.101460 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:08.425092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4da55-3f43-4616-93aa-24341ac91ab6 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:08.434686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4da55-3f43-4616-93aa-24341ac91ab6 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:08.438247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:08.438970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:08.439263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:08.439534 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:08.441273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:08.504915 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:08.507367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:08.519414 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1317/2629] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:58:12.163935 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:12.170261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:12.181589 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ce432-fd8b-45fb-8ca0-969545bbc644 service swift] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:12.186220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:12.187144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:12.187430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:12.187709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] PATH_INFO: `/v3/users/98a275f65a3544a5b073fbf1ee10034b` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:12.201861 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a275f65a3544a5b073fbf1ee10034b)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:12.203819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:12.387557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a275f65a3544a5b073fbf1ee10034b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.388208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a275f65a3544a5b073fbf1ee10034b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.388806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a275f65a3544a5b073fbf1ee10034b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.401181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a275f65a3544a5b073fbf1ee10034b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.408022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-77f017cd-2d24-4108-82b3-512083ff1e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a275f65a3544a5b073fbf1ee10034b'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.491252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1313/2630] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:58:12 2022] DELETE /identity/v3/users/98a275f65a3544a5b073fbf1ee10034b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:12.735280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:12.745901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b260834-7ef0-437e-ab25-97c493959625 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:12.806104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:12.807069 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:12.807349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:12.807621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] PATH_INFO: `/v3/projects/cffce3a08ba34b79aadf8d0399aff80f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:12.819162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cffce3a08ba34b79aadf8d0399aff80f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:12.821176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:12.928615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cffce3a08ba34b79aadf8d0399aff80f', 'request_id': 'req-0c3763d2-c8d9-4580-9cbd-0ac853905f89'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:12.934559 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cffce3a08ba34b79aadf8d0399aff80f', 'request_id': 'req-0c3763d2-c8d9-4580-9cbd-0ac853905f89'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:13.013584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cffce3a08ba34b79aadf8d0399aff80f', 'request_id': 'req-0c3763d2-c8d9-4580-9cbd-0ac853905f89'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:13.028484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] The token cache is being invalidate because project cffce3a08ba34b79aadf8d0399aff80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:58:13.028730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:13.032214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-0c3763d2-c8d9-4580-9cbd-0ac853905f89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:58:13.032214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1318/2631] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:58:12 2022] DELETE /identity/v3/projects/cffce3a08ba34b79aadf8d0399aff80f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:13.036208 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e107521-a936-48d2-a3f5-4f54c007dd7a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.036497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e107521-a936-48d2-a3f5-4f54c007dd7a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.037085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e107521-a936-48d2-a3f5-4f54c007dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.057157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-6e107521-a936-48d2-a3f5-4f54c007dd7a None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:13.060687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6e107521-a936-48d2-a3f5-4f54c007dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:13.121763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1314/2632] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:13.130180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf8ef-421c-459e-9e43-1032c482361f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.130303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf8ef-421c-459e-9e43-1032c482361f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.130673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990bf8ef-421c-459e-9e43-1032c482361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.149205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-990bf8ef-421c-459e-9e43-1032c482361f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:13.150474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-990bf8ef-421c-459e-9e43-1032c482361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:13.158435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1319/2633] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:13.162835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e107521-a936-48d2-a3f5-4f54c007dd7a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:13.172386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e107521-a936-48d2-a3f5-4f54c007dd7a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:13.176957 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:13.178162 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.178513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.178862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.179581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:58:13.179884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:13.181471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:13.192903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1315/2634] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:58:13.197642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bf8ef-421c-459e-9e43-1032c482361f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:13.206757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990bf8ef-421c-459e-9e43-1032c482361f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:13.211570 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b62317-1789-41bf-8623-a233274ebce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:13.212222 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62317-1789-41bf-8623-a233274ebce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.212507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62317-1789-41bf-8623-a233274ebce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.212779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b62317-1789-41bf-8623-a233274ebce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.213474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b62317-1789-41bf-8623-a233274ebce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:13.215403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b62317-1789-41bf-8623-a233274ebce9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:13.219417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:13.360328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1320/2635] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:58:13 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:58:13.364559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:13.377147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c59bb-8afc-4087-b4ad-31c612037617 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:13.423087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:13.435061 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674451a-9755-47ed-8882-e05325602ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:13.435736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674451a-9755-47ed-8882-e05325602ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.436017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674451a-9755-47ed-8882-e05325602ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.436294 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6674451a-9755-47ed-8882-e05325602ce0 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.436989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674451a-9755-47ed-8882-e05325602ce0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:13.438923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6674451a-9755-47ed-8882-e05325602ce0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:13.506570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1316/2636] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:58:13 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:58:13.509355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b62317-1789-41bf-8623-a233274ebce9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:13.520060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b62317-1789-41bf-8623-a233274ebce9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:13.524770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7c5f6-47d0-4af7-a9a0-baec420dd152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:13.525434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c5f6-47d0-4af7-a9a0-baec420dd152 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.525719 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c5f6-47d0-4af7-a9a0-baec420dd152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.525995 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f7c5f6-47d0-4af7-a9a0-baec420dd152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.526772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7c5f6-47d0-4af7-a9a0-baec420dd152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:13.528337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f7c5f6-47d0-4af7-a9a0-baec420dd152 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:13.539038 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1321/2637] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:13.543177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674451a-9755-47ed-8882-e05325602ce0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:13.554104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6674451a-9755-47ed-8882-e05325602ce0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:13.559384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57e04c-17c3-4e7a-8449-a01d793f399c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:13.561451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e04c-17c3-4e7a-8449-a01d793f399c admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.561451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e04c-17c3-4e7a-8449-a01d793f399c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.561451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57e04c-17c3-4e7a-8449-a01d793f399c admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.561451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e04c-17c3-4e7a-8449-a01d793f399c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:13.562919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57e04c-17c3-4e7a-8449-a01d793f399c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:13.573445 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1317/2638] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:58:13.577437 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7c5f6-47d0-4af7-a9a0-baec420dd152 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:13.588065 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f7c5f6-47d0-4af7-a9a0-baec420dd152 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:13.592690 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f166e-8e9a-46d7-938f-6f419f4579ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:13.593569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f166e-8e9a-46d7-938f-6f419f4579ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.593846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f166e-8e9a-46d7-938f-6f419f4579ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.594116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f166e-8e9a-46d7-938f-6f419f4579ad admin admin] PATH_INFO: `/v3/projects/61e950d2769542448b606e9bb4d471f8/users/1d3d63e5297d4ee4b8a6e6a1ab8b16c9/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.609790 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f166e-8e9a-46d7-938f-6f419f4579ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e950d2769542448b606e9bb4d471f8, user_id=1d3d63e5297d4ee4b8a6e6a1ab8b16c9, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:13.612492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f166e-8e9a-46d7-938f-6f419f4579ad admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:13.659475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1322/2639] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:58:13 2022] PUT /identity/v3/projects/61e950d2769542448b606e9bb4d471f8/users/1d3d63e5297d4ee4b8a6e6a1ab8b16c9/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:13.669517 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74040-fa0a-42f7-a839-98a2990edf73 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.669806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74040-fa0a-42f7-a839-98a2990edf73 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.670082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74040-fa0a-42f7-a839-98a2990edf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.701829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e4e74040-fa0a-42f7-a839-98a2990edf73 None None] MFA Rules not processed for user `1d3d63e5297d4ee4b8a6e6a1ab8b16c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:13.703556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e4e74040-fa0a-42f7-a839-98a2990edf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:13.775440 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1318/2640] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:58:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:13.780062 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f166e-8e9a-46d7-938f-6f419f4579ad admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:13.842992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f166e-8e9a-46d7-938f-6f419f4579ad admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:13.847708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37fbd5-d9d3-4516-9234-e3d6dbd586fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:13.848358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fbd5-d9d3-4516-9234-e3d6dbd586fa admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:13.848635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fbd5-d9d3-4516-9234-e3d6dbd586fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:13.848901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37fbd5-d9d3-4516-9234-e3d6dbd586fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:13.850144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37fbd5-d9d3-4516-9234-e3d6dbd586fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:13.852051 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e37fbd5-d9d3-4516-9234-e3d6dbd586fa admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:13.929316 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1323/2641] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:58:13 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:58:13.933395 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74040-fa0a-42f7-a839-98a2990edf73 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:13.944295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74040-fa0a-42f7-a839-98a2990edf73 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:14.000476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9045ab-30b5-4cce-9667-2dc98768b08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:14.001153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9045ab-30b5-4cce-9667-2dc98768b08d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:14.001432 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9045ab-30b5-4cce-9667-2dc98768b08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:14.001714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9045ab-30b5-4cce-9667-2dc98768b08d admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:14.002406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9045ab-30b5-4cce-9667-2dc98768b08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:14.004384 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9045ab-30b5-4cce-9667-2dc98768b08d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:14.073002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1319/2642] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:58:13 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:58:14.076885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37fbd5-d9d3-4516-9234-e3d6dbd586fa admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:14.088063 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e37fbd5-d9d3-4516-9234-e3d6dbd586fa admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:14.093017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7d2a7-65a7-432f-8d5d-bae3cdc6b142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:14.093684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7d2a7-65a7-432f-8d5d-bae3cdc6b142 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:14.093969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7d2a7-65a7-432f-8d5d-bae3cdc6b142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:14.094245 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b7d2a7-65a7-432f-8d5d-bae3cdc6b142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:14.095011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7d2a7-65a7-432f-8d5d-bae3cdc6b142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:14.096731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b7d2a7-65a7-432f-8d5d-bae3cdc6b142 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:14.108043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1324/2643] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:14.112172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9045ab-30b5-4cce-9667-2dc98768b08d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:14.122853 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9045ab-30b5-4cce-9667-2dc98768b08d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:14.128176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc505ee-bdf6-47c9-b868-7f799572d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:14.129590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc505ee-bdf6-47c9-b868-7f799572d24b admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:14.129878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc505ee-bdf6-47c9-b868-7f799572d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:14.130153 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc505ee-bdf6-47c9-b868-7f799572d24b admin admin] PATH_INFO: `/v3/projects/a5546448e0c54dde943db3bd83a79597/users/1f1c22b3bb0b45c3919a6feb116a5b64/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:14.145192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc505ee-bdf6-47c9-b868-7f799572d24b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5546448e0c54dde943db3bd83a79597, user_id=1f1c22b3bb0b45c3919a6feb116a5b64, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:14.148490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc505ee-bdf6-47c9-b868-7f799572d24b admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:14.230971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1320/2644] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:58:14 2022] PUT /identity/v3/projects/a5546448e0c54dde943db3bd83a79597/users/1f1c22b3bb0b45c3919a6feb116a5b64/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:14.235043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7d2a7-65a7-432f-8d5d-bae3cdc6b142 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:14.245120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b7d2a7-65a7-432f-8d5d-bae3cdc6b142 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:14.304298 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c889c1e-2296-4eb3-9cde-14a2c6a3c0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:14.304963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c1e-2296-4eb3-9cde-14a2c6a3c0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:14.305242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c1e-2296-4eb3-9cde-14a2c6a3c0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:14.305515 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c889c1e-2296-4eb3-9cde-14a2c6a3c0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:14.306260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c889c1e-2296-4eb3-9cde-14a2c6a3c0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:14.307902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c889c1e-2296-4eb3-9cde-14a2c6a3c0b5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:14.317635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1325/2645] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:58:14.322329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc505ee-bdf6-47c9-b868-7f799572d24b admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:14.332637 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc505ee-bdf6-47c9-b868-7f799572d24b admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:14.337953 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:14.338927 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:14.339192 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:14.348545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] PATH_INFO: `/v3/projects/a5546448e0c54dde943db3bd83a79597/users/1f1c22b3bb0b45c3919a6feb116a5b64/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:14.348545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5546448e0c54dde943db3bd83a79597, user_id=1f1c22b3bb0b45c3919a6feb116a5b64, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:14.348545 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:14.354684 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1321/2646] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:58:14 2022] PUT /identity/v3/projects/a5546448e0c54dde943db3bd83a79597/users/1f1c22b3bb0b45c3919a6feb116a5b64/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:58:14.366119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e1c09-887a-439f-bf42-39bdda95a495 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:14.366413 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e1c09-887a-439f-bf42-39bdda95a495 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:14.366732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e1c09-887a-439f-bf42-39bdda95a495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:14.399854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7f1e1c09-887a-439f-bf42-39bdda95a495 None None] MFA Rules not processed for user `1f1c22b3bb0b45c3919a6feb116a5b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:58:14.401265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7f1e1c09-887a-439f-bf42-39bdda95a495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:14.410827 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:14.470333 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1326/2647] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:58:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:58:14.481744 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:14.483421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:58:14.495298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:14.542187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980c67a-9471-4982-a30f-ef71d84ab099 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:14.546625 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfdc7e-f6ab-41ec-92f1-6387b8031f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:14.547290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfdc7e-f6ab-41ec-92f1-6387b8031f48 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:14.547568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfdc7e-f6ab-41ec-92f1-6387b8031f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:14.547845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfdc7e-f6ab-41ec-92f1-6387b8031f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:14.556793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfdc7e-f6ab-41ec-92f1-6387b8031f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:14.558195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfdc7e-f6ab-41ec-92f1-6387b8031f48 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:14.567389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1322/2648] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:58:14.797505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e1c09-887a-439f-bf42-39bdda95a495 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:58:14.808144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e1c09-887a-439f-bf42-39bdda95a495 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:58:14.811846 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b63f2c-e60c-4ab4-bdd4-87ce00650861 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:58:14.812491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63f2c-e60c-4ab4-bdd4-87ce00650861 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:58:14.812773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63f2c-e60c-4ab4-bdd4-87ce00650861 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:58:14.813046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b63f2c-e60c-4ab4-bdd4-87ce00650861 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:58:14.870216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63f2c-e60c-4ab4-bdd4-87ce00650861 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:58:14.871679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b63f2c-e60c-4ab4-bdd4-87ce00650861 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:58:14.880498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1327/2649] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:58:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:58:24.573098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=22 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:58:24.877634 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=52 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:09.824403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfdc7e-f6ab-41ec-92f1-6387b8031f48 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:09.928124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfdc7e-f6ab-41ec-92f1-6387b8031f48 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:09.932702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:09.933569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:09.933850 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:09.934121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] PATH_INFO: `/v3/users/1d3d63e5297d4ee4b8a6e6a1ab8b16c9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:09.935359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d3d63e5297d4ee4b8a6e6a1ab8b16c9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:09.937281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:10.112731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d3d63e5297d4ee4b8a6e6a1ab8b16c9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:10.113481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d3d63e5297d4ee4b8a6e6a1ab8b16c9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:10.114609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d3d63e5297d4ee4b8a6e6a1ab8b16c9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:10.126867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d3d63e5297d4ee4b8a6e6a1ab8b16c9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:10.134338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d3d63e5297d4ee4b8a6e6a1ab8b16c9'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:10.235494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1323/2650] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:09 2022] DELETE /identity/v3/users/1d3d63e5297d4ee4b8a6e6a1ab8b16c9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:10.240755 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b9aa-3ebb-4b16-bcfd-7e90b0df6326 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:10.241236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b9aa-3ebb-4b16-bcfd-7e90b0df6326 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:10.241354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371b9aa-3ebb-4b16-bcfd-7e90b0df6326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:10.289176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9371b9aa-3ebb-4b16-bcfd-7e90b0df6326 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:10.290415 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9371b9aa-3ebb-4b16-bcfd-7e90b0df6326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:10.347017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1328/2651] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:10.356697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:10.358093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:10.400351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:10.451602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b818e6f-56d1-4714-a8c0-19308146f716 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:10.455136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b3e92-3a7f-433d-a3b2-effc187fd65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:10.455780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3e92-3a7f-433d-a3b2-effc187fd65b service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:10.456056 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3e92-3a7f-433d-a3b2-effc187fd65b service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:10.456326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b3e92-3a7f-433d-a3b2-effc187fd65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:10.465077 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b3e92-3a7f-433d-a3b2-effc187fd65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:10.466488 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b3e92-3a7f-433d-a3b2-effc187fd65b service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:10.477714 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1324/2652] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:11.013731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b9aa-3ebb-4b16-bcfd-7e90b0df6326 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:11.016828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9371b9aa-3ebb-4b16-bcfd-7e90b0df6326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:11.028282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9371b9aa-3ebb-4b16-bcfd-7e90b0df6326 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:11.032869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:11.033796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:11.034040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:11.034312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] PATH_INFO: `/v3/projects/61e950d2769542448b606e9bb4d471f8` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:11.036406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e950d2769542448b606e9bb4d471f8)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:11.038509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:11.144256 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e950d2769542448b606e9bb4d471f8', 'request_id': 'req-35b25771-409f-4900-af1c-93694633db21'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.150742 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e950d2769542448b606e9bb4d471f8', 'request_id': 'req-35b25771-409f-4900-af1c-93694633db21'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.233265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e950d2769542448b606e9bb4d471f8', 'request_id': 'req-35b25771-409f-4900-af1c-93694633db21'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.245760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] The token cache is being invalidate because project 61e950d2769542448b606e9bb4d471f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:11.246378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.246707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.248248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1329/2653] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:11 2022] DELETE /identity/v3/projects/61e950d2769542448b606e9bb4d471f8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:11.252233 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b3e92-3a7f-433d-a3b2-effc187fd65b service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:11.262615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b3e92-3a7f-433d-a3b2-effc187fd65b service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:11.320587 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:11.321464 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:11.321741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:11.322019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] PATH_INFO: `/v3/users/1f1c22b3bb0b45c3919a6feb116a5b64` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:11.323219 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1c22b3bb0b45c3919a6feb116a5b64)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:11.325109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:11.506792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1c22b3bb0b45c3919a6feb116a5b64'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.507419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1c22b3bb0b45c3919a6feb116a5b64'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.508006 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1c22b3bb0b45c3919a6feb116a5b64'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.521018 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1c22b3bb0b45c3919a6feb116a5b64'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.527906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1c22b3bb0b45c3919a6feb116a5b64'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:11.595695 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1325/2654] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:11 2022] DELETE /identity/v3/users/1f1c22b3bb0b45c3919a6feb116a5b64 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:59:12.018578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.020267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:12.025253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.026659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:12.066034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:12.086778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25771-409f-4900-af1c-93694633db21 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.095527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:12.103326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff201f-6f79-41d4-8308-c4aa50509d1e admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.107904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.108805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.110765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.110765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] PATH_INFO: `/v3/projects/a5546448e0c54dde943db3bd83a79597` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.110765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5546448e0c54dde943db3bd83a79597)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.112443 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.138906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac164323-257f-4f50-adba-6a271f7f8036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.139564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164323-257f-4f50-adba-6a271f7f8036 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.143030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164323-257f-4f50-adba-6a271f7f8036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.143030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac164323-257f-4f50-adba-6a271f7f8036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.143030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ac164323-257f-4f50-adba-6a271f7f8036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:12.154633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac164323-257f-4f50-adba-6a271f7f8036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.156876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac164323-257f-4f50-adba-6a271f7f8036 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.167774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1330/2655] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:12.230958 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5546448e0c54dde943db3bd83a79597', 'request_id': 'req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.236999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5546448e0c54dde943db3bd83a79597', 'request_id': 'req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.243578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5546448e0c54dde943db3bd83a79597', 'request_id': 'req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.341970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] The token cache is being invalidate because project a5546448e0c54dde943db3bd83a79597 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:12.342674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.342980 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1372fd62-3351-4d9f-85f9-c3dbad6a5a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:12.344530 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1326/2656] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:12 2022] DELETE /identity/v3/projects/a5546448e0c54dde943db3bd83a79597 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 12:59:12.350093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bc63a-c3d9-47af-8dd0-0afbdd7b2450 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.350617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bc63a-c3d9-47af-8dd0-0afbdd7b2450 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.350729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7bc63a-c3d9-47af-8dd0-0afbdd7b2450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.380436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-7d7bc63a-c3d9-47af-8dd0-0afbdd7b2450 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:12.381623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7d7bc63a-c3d9-47af-8dd0-0afbdd7b2450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:12.443229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1331/2657] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:12.451353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ebb6-687e-4aef-a27e-239ec4f73074 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.456211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ebb6-687e-4aef-a27e-239ec4f73074 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.456211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806ebb6-687e-4aef-a27e-239ec4f73074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.470513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-5806ebb6-687e-4aef-a27e-239ec4f73074 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:12.471735 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-5806ebb6-687e-4aef-a27e-239ec4f73074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:12.480450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1327/2658] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:12.484812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bc63a-c3d9-47af-8dd0-0afbdd7b2450 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.494931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7bc63a-c3d9-47af-8dd0-0afbdd7b2450 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.499434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.500101 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.500378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.500649 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.501367 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:12.501673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.503295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.515214 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1332/2659] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 12:59:12.520981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ebb6-687e-4aef-a27e-239ec4f73074 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.530140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806ebb6-687e-4aef-a27e-239ec4f73074 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.534866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d174bc2-a6ec-4bec-a875-93236fc52911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.535521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d174bc2-a6ec-4bec-a875-93236fc52911 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.536376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d174bc2-a6ec-4bec-a875-93236fc52911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.536611 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d174bc2-a6ec-4bec-a875-93236fc52911 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.537293 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d174bc2-a6ec-4bec-a875-93236fc52911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.539227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d174bc2-a6ec-4bec-a875-93236fc52911 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.636981 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1328/2660] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:59:12 2022] POST /identity/v3/projects => generated 355 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:12.638406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.650641 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fe4ca-aa90-46f4-82b2-58d52fd3490d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.712972 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ede97-830a-4153-809f-f455e0d23fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.713698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ede97-830a-4153-809f-f455e0d23fac admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.714058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ede97-830a-4153-809f-f455e0d23fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.714219 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ede97-830a-4153-809f-f455e0d23fac admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.714960 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ede97-830a-4153-809f-f455e0d23fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.716902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ede97-830a-4153-809f-f455e0d23fac admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.819240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1333/2661] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:59:12 2022] POST /identity/v3/users => generated 278 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:12.823324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d174bc2-a6ec-4bec-a875-93236fc52911 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.833797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d174bc2-a6ec-4bec-a875-93236fc52911 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.838510 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d8f1-1830-4b09-b0d5-37de04209ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.839220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d8f1-1830-4b09-b0d5-37de04209ced admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.839507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d8f1-1830-4b09-b0d5-37de04209ced admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.839787 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217d8f1-1830-4b09-b0d5-37de04209ced admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.840519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217d8f1-1830-4b09-b0d5-37de04209ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.842127 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217d8f1-1830-4b09-b0d5-37de04209ced admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.854888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1329/2662] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:12.859079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ede97-830a-4153-809f-f455e0d23fac admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.870213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ede97-830a-4153-809f-f455e0d23fac admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.874978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9810d1-086e-4c42-82b1-e5040f8d892b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.875670 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9810d1-086e-4c42-82b1-e5040f8d892b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.875951 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9810d1-086e-4c42-82b1-e5040f8d892b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.876379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9810d1-086e-4c42-82b1-e5040f8d892b admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.877000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9810d1-086e-4c42-82b1-e5040f8d892b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.878619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9810d1-086e-4c42-82b1-e5040f8d892b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:12.888771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1334/2663] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:59:12.893052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d8f1-1830-4b09-b0d5-37de04209ced admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:12.904419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217d8f1-1830-4b09-b0d5-37de04209ced admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:12.909249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4bd2-142e-4a74-90cb-c44500e13461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:12.913877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4bd2-142e-4a74-90cb-c44500e13461 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:12.913877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4bd2-142e-4a74-90cb-c44500e13461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:12.913877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef4bd2-142e-4a74-90cb-c44500e13461 admin admin] PATH_INFO: `/v3/projects/886a80da9147401994618cceff0180ea/users/8e4b74ff193840ae9b52656571fb66b5/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:12.927436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4bd2-142e-4a74-90cb-c44500e13461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=886a80da9147401994618cceff0180ea, user_id=8e4b74ff193840ae9b52656571fb66b5, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:12.930107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef4bd2-142e-4a74-90cb-c44500e13461 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:13.029852 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1330/2664] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:12 2022] PUT /identity/v3/projects/886a80da9147401994618cceff0180ea/users/8e4b74ff193840ae9b52656571fb66b5/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:13.041293 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbeed-8ace-4e05-a91c-2a4cc1743250 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.041585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbeed-8ace-4e05-a91c-2a4cc1743250 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.041865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206fbeed-8ace-4e05-a91c-2a4cc1743250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.069879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-206fbeed-8ace-4e05-a91c-2a4cc1743250 None None] MFA Rules not processed for user `8e4b74ff193840ae9b52656571fb66b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:13.071100 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-206fbeed-8ace-4e05-a91c-2a4cc1743250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:13.075078 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:13.142282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1335/2665] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:13 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:13.146880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4bd2-142e-4a74-90cb-c44500e13461 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:13.213326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:13.226328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef4bd2-142e-4a74-90cb-c44500e13461 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:13.231739 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9bf7-47e4-4236-8db8-ecac3d8451e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:13.232664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9bf7-47e4-4236-8db8-ecac3d8451e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.233476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9bf7-47e4-4236-8db8-ecac3d8451e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.233476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d9bf7-47e4-4236-8db8-ecac3d8451e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.234328 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d9bf7-47e4-4236-8db8-ecac3d8451e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:13.237327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d9bf7-47e4-4236-8db8-ecac3d8451e0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:13.326733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1331/2666] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:59:13 2022] POST /identity/v3/projects => generated 357 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:13.327865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fbeed-8ace-4e05-a91c-2a4cc1743250 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:13.339483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206fbeed-8ace-4e05-a91c-2a4cc1743250 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:13.398572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986fe29-b528-4efc-a615-3f4cc69a3fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:13.399348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fe29-b528-4efc-a615-3f4cc69a3fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.399533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fe29-b528-4efc-a615-3f4cc69a3fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.399743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986fe29-b528-4efc-a615-3f4cc69a3fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.400446 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986fe29-b528-4efc-a615-3f4cc69a3fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:13.402362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986fe29-b528-4efc-a615-3f4cc69a3fc8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:13.518435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1336/2667] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:59:13 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:13.519642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9bf7-47e4-4236-8db8-ecac3d8451e0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:13.530439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d9bf7-47e4-4236-8db8-ecac3d8451e0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:13.535007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98ef58-08b6-4d97-b194-cc079762eb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:13.536829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ef58-08b6-4d97-b194-cc079762eb13 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.537122 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ef58-08b6-4d97-b194-cc079762eb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.537408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98ef58-08b6-4d97-b194-cc079762eb13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.538144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98ef58-08b6-4d97-b194-cc079762eb13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:13.539780 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98ef58-08b6-4d97-b194-cc079762eb13 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:13.551444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1332/2668] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:59:13.556614 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986fe29-b528-4efc-a615-3f4cc69a3fc8 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:13.566513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986fe29-b528-4efc-a615-3f4cc69a3fc8 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:13.571314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35355e-1c14-4395-8533-354fe502377e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:13.576748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35355e-1c14-4395-8533-354fe502377e admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.576748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35355e-1c14-4395-8533-354fe502377e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.576748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35355e-1c14-4395-8533-354fe502377e admin admin] PATH_INFO: `/v3/projects/659a1c2a72364a16a5fb79f5b3cca7a9/users/50c1e0c08a8d4170b52848411beac5dd/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.588089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35355e-1c14-4395-8533-354fe502377e admin admin] RBAC: Authorizing `identity:create_grant(project_id=659a1c2a72364a16a5fb79f5b3cca7a9, user_id=50c1e0c08a8d4170b52848411beac5dd, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:13.590779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35355e-1c14-4395-8533-354fe502377e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:13.694847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1337/2669] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:13 2022] PUT /identity/v3/projects/659a1c2a72364a16a5fb79f5b3cca7a9/users/50c1e0c08a8d4170b52848411beac5dd/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:13.698896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98ef58-08b6-4d97-b194-cc079762eb13 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:13.711197 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98ef58-08b6-4d97-b194-cc079762eb13 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:13.782795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94623368-8a77-4418-b4ea-9df93beaca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:13.783475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623368-8a77-4418-b4ea-9df93beaca04 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.783761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623368-8a77-4418-b4ea-9df93beaca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.784029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94623368-8a77-4418-b4ea-9df93beaca04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.784750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623368-8a77-4418-b4ea-9df93beaca04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:13.787239 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94623368-8a77-4418-b4ea-9df93beaca04 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:13.798372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1333/2670] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:13.802989 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35355e-1c14-4395-8533-354fe502377e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:13.813857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35355e-1c14-4395-8533-354fe502377e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:13.819111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:13.820019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.820334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.820608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] PATH_INFO: `/v3/projects/659a1c2a72364a16a5fb79f5b3cca7a9/users/50c1e0c08a8d4170b52848411beac5dd/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.822586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=659a1c2a72364a16a5fb79f5b3cca7a9, user_id=50c1e0c08a8d4170b52848411beac5dd, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:13.827795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:13.839435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1338/2671] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:13 2022] PUT /identity/v3/projects/659a1c2a72364a16a5fb79f5b3cca7a9/users/50c1e0c08a8d4170b52848411beac5dd/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:13.850878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127919-9685-46b3-af91-f3da6f47505a None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:13.851304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127919-9685-46b3-af91-f3da6f47505a None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:13.851620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e127919-9685-46b3-af91-f3da6f47505a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:13.881962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4e127919-9685-46b3-af91-f3da6f47505a None None] MFA Rules not processed for user `50c1e0c08a8d4170b52848411beac5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:13.883193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4e127919-9685-46b3-af91-f3da6f47505a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:13.959623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1334/2672] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:13 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:13.971610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:13.974311 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:14.038883 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d10c-27d0-4c61-8f20-38a8dc76a5ae admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.043113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.043783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.044071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.044350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.054609 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.056060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:14.061508 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:14.067567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1339/2673] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:13 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:14.402723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127919-9685-46b3-af91-f3da6f47505a None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:14.412211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e127919-9685-46b3-af91-f3da6f47505a None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:14.415730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57aa10-f3c5-48ee-b6b3-dd40fe1523d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:14.416318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57aa10-f3c5-48ee-b6b3-dd40fe1523d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:14.416598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57aa10-f3c5-48ee-b6b3-dd40fe1523d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:14.416873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57aa10-f3c5-48ee-b6b3-dd40fe1523d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:14.465367 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:14.481624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57aa10-f3c5-48ee-b6b3-dd40fe1523d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:14.483679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57aa10-f3c5-48ee-b6b3-dd40fe1523d5 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:14.496727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1335/2674] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:14 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:16.139724 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:16.141248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:16.207211 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfcf713-9caa-4381-8ae1-410c465c53e3 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:16.212376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:16.213249 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:16.213529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:16.213802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] PATH_INFO: `/v3/users/34cd6fbd9b654e31a387acc25ee94d44` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:16.215148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34cd6fbd9b654e31a387acc25ee94d44)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:16.217196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:16.390640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34cd6fbd9b654e31a387acc25ee94d44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:16.391684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34cd6fbd9b654e31a387acc25ee94d44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:16.400689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34cd6fbd9b654e31a387acc25ee94d44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:16.413120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34cd6fbd9b654e31a387acc25ee94d44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:16.413849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c08a6cb6-2cae-4911-a112-3db52bef7f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34cd6fbd9b654e31a387acc25ee94d44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:16.527288 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1340/2675] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:16 2022] DELETE /identity/v3/users/34cd6fbd9b654e31a387acc25ee94d44 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:16.823967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57aa10-f3c5-48ee-b6b3-dd40fe1523d5 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:16.836119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57aa10-f3c5-48ee-b6b3-dd40fe1523d5 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:16.893972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:16.894874 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:16.896651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:16.897089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] PATH_INFO: `/v3/projects/60655349037a415e8d26e794e9d3cc79` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:16.898213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60655349037a415e8d26e794e9d3cc79)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:16.900190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:16.998467 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60655349037a415e8d26e794e9d3cc79', 'request_id': 'req-f08c872d-8305-441a-8e1c-69a6d4c38ea5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:17.005044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60655349037a415e8d26e794e9d3cc79', 'request_id': 'req-f08c872d-8305-441a-8e1c-69a6d4c38ea5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:17.010669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60655349037a415e8d26e794e9d3cc79', 'request_id': 'req-f08c872d-8305-441a-8e1c-69a6d4c38ea5'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:17.090694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] The token cache is being invalidate because project 60655349037a415e8d26e794e9d3cc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:17.090987 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:17.091652 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-f08c872d-8305-441a-8e1c-69a6d4c38ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:17.093231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1336/2676] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:16 2022] DELETE /identity/v3/projects/60655349037a415e8d26e794e9d3cc79 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:17.099126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205c8b-6aa8-4f49-bb26-09c591b54804 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.099419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205c8b-6aa8-4f49-bb26-09c591b54804 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.099693 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70205c8b-6aa8-4f49-bb26-09c591b54804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.121796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-70205c8b-6aa8-4f49-bb26-09c591b54804 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:17.123208 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-70205c8b-6aa8-4f49-bb26-09c591b54804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:17.184962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1341/2677] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:17.193599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a39b-0f76-4463-9cc3-d9607b61bd08 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.193890 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a39b-0f76-4463-9cc3-d9607b61bd08 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.194172 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79a39b-0f76-4463-9cc3-d9607b61bd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.213102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fa79a39b-0f76-4463-9cc3-d9607b61bd08 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:17.214305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fa79a39b-0f76-4463-9cc3-d9607b61bd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:17.222124 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1337/2678] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:17.226495 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70205c8b-6aa8-4f49-bb26-09c591b54804 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:17.236545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70205c8b-6aa8-4f49-bb26-09c591b54804 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:17.241877 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:17.242569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.242858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.243134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.243858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:17.244421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:17.246072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:17.258506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1342/2679] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:17.263121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79a39b-0f76-4463-9cc3-d9607b61bd08 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:17.272883 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79a39b-0f76-4463-9cc3-d9607b61bd08 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:17.277549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8aa5-b9c8-4590-ad57-fd365c50e3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:17.278209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8aa5-b9c8-4590-ad57-fd365c50e3bb admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.278493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8aa5-b9c8-4590-ad57-fd365c50e3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.278802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8aa5-b9c8-4590-ad57-fd365c50e3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.279508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8aa5-b9c8-4590-ad57-fd365c50e3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:17.281512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e8aa5-b9c8-4590-ad57-fd365c50e3bb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:17.368995 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1338/2680] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:59:17 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:17.373513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:17.384246 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2b453-58d4-4ca5-b392-6b02590b6ec3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:17.388162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:17.460089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d50f0-a655-4410-b89e-e2e6e0a2c10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:17.460839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d50f0-a655-4410-b89e-e2e6e0a2c10c admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.461122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d50f0-a655-4410-b89e-e2e6e0a2c10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.461404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0d50f0-a655-4410-b89e-e2e6e0a2c10c admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.462102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d50f0-a655-4410-b89e-e2e6e0a2c10c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:17.464083 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0d50f0-a655-4410-b89e-e2e6e0a2c10c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:17.594172 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1343/2681] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:59:17 2022] POST /identity/v3/users => generated 288 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:17.598924 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8aa5-b9c8-4590-ad57-fd365c50e3bb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:17.608989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8aa5-b9c8-4590-ad57-fd365c50e3bb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:17.614317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28129d76-49e0-440e-8d80-f342932193a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:17.615032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129d76-49e0-440e-8d80-f342932193a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.615320 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129d76-49e0-440e-8d80-f342932193a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.615598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28129d76-49e0-440e-8d80-f342932193a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.616330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28129d76-49e0-440e-8d80-f342932193a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:17.617979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28129d76-49e0-440e-8d80-f342932193a8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:17.628919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1339/2682] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:17.633651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d50f0-a655-4410-b89e-e2e6e0a2c10c admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:17.643735 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0d50f0-a655-4410-b89e-e2e6e0a2c10c admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:17.649036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12fddd5-bc29-424e-866a-3f2165f0724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:17.649695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fddd5-bc29-424e-866a-3f2165f0724b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.649978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fddd5-bc29-424e-866a-3f2165f0724b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.650255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12fddd5-bc29-424e-866a-3f2165f0724b admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.651044 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fddd5-bc29-424e-866a-3f2165f0724b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:17.652661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12fddd5-bc29-424e-866a-3f2165f0724b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:17.664006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1344/2683] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:17.668638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28129d76-49e0-440e-8d80-f342932193a8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:17.679843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28129d76-49e0-440e-8d80-f342932193a8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:17.684351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:17.685288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.685643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.685872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] PATH_INFO: `/v3/projects/fcb152674fde4beebd5a106495b1ab2c/users/563aa380be524bc7970d486ce9ae82c7/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.701180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb152674fde4beebd5a106495b1ab2c, user_id=563aa380be524bc7970d486ce9ae82c7, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:17.703922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:17.784800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1340/2684] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:17 2022] PUT /identity/v3/projects/fcb152674fde4beebd5a106495b1ab2c/users/563aa380be524bc7970d486ce9ae82c7/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:17.790458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a88df-68f6-4e35-8d17-1f365d3aa1d7 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.790770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a88df-68f6-4e35-8d17-1f365d3aa1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.791046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a88df-68f6-4e35-8d17-1f365d3aa1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.809265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5f3a88df-68f6-4e35-8d17-1f365d3aa1d7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:17.810447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5f3a88df-68f6-4e35-8d17-1f365d3aa1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:17.869702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1345/2685] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:17.880315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:17.882178 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:17.895738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:17.939459 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6fbdf-f6bd-4ce8-973a-290a72501dad admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:17.943368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:17.944011 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:17.944295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:17.944569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:17.953542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:17.955001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:17.968314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1341/2686] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:23.610564 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962ece-4ce0-46fa-ba89-a7450ba25c98 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:23.611099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962ece-4ce0-46fa-ba89-a7450ba25c98 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:23.611258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20962ece-4ce0-46fa-ba89-a7450ba25c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:23.643190 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-20962ece-4ce0-46fa-ba89-a7450ba25c98 None None] MFA Rules not processed for user `563aa380be524bc7970d486ce9ae82c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:23.644412 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-20962ece-4ce0-46fa-ba89-a7450ba25c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:23.721404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1346/2687] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:23.738131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:23.740506 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:23.837949 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018df25c-bd64-4957-a09e-293ce65887e9 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:23.843841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4a1ac-ce1e-4a91-be88-faea8b3372bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:23.844514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4a1ac-ce1e-4a91-be88-faea8b3372bc service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:23.844793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4a1ac-ce1e-4a91-be88-faea8b3372bc service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:23.845085 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4a1ac-ce1e-4a91-be88-faea8b3372bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:23.853899 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4a1ac-ce1e-4a91-be88-faea8b3372bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:23.855528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4a1ac-ce1e-4a91-be88-faea8b3372bc service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:23.865551 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1342/2688] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:27.364789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15454-9e93-498f-9dea-eb2bdcc7c63e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:27.367422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15454-9e93-498f-9dea-eb2bdcc7c63e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:27.367422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b15454-9e93-498f-9dea-eb2bdcc7c63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:27.385712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-87b15454-9e93-498f-9dea-eb2bdcc7c63e None None] MFA Rules not processed for user `563aa380be524bc7970d486ce9ae82c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:27.387064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-87b15454-9e93-498f-9dea-eb2bdcc7c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:27.395388 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1347/2689] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:27.726903 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4a1ac-ce1e-4a91-be88-faea8b3372bc service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:27.736174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4a1ac-ce1e-4a91-be88-faea8b3372bc service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:27.740809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:27.741447 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:27.741734 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:27.742012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:27.743798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:27.753647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:27.755904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:27.764107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1343/2690] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:28.199662 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b15454-9e93-498f-9dea-eb2bdcc7c63e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:28.201115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-87b15454-9e93-498f-9dea-eb2bdcc7c63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:28.212394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:28.273774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b15454-9e93-498f-9dea-eb2bdcc7c63e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:28.279416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:28.280193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:28.280478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:28.280750 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:28.282647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:28.295416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:28.297016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:28.308303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1348/2691] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 12:59:31.671660 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:31.673134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:31.684022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664d0d2-42df-4fb0-81b7-ae27aa4194a7 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:31.687629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a4062-fb3a-4aa5-a36a-6028c65d2020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:31.688267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4062-fb3a-4aa5-a36a-6028c65d2020 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:31.688572 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4062-fb3a-4aa5-a36a-6028c65d2020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:31.688848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a4062-fb3a-4aa5-a36a-6028c65d2020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:31.690570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-698a4062-fb3a-4aa5-a36a-6028c65d2020 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:31.701307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4062-fb3a-4aa5-a36a-6028c65d2020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:31.702878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a4062-fb3a-4aa5-a36a-6028c65d2020 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:31.711412 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1344/2692] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:33.912472 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:33.913982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:33.927992 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea72ae-01ca-4d2d-9498-08d8ffbaa919 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:33.932440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:33.933383 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:33.933665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:33.933941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] PATH_INFO: `/v3/users/8e4b74ff193840ae9b52656571fb66b5` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:33.935144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e4b74ff193840ae9b52656571fb66b5)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:33.937029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.111476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e4b74ff193840ae9b52656571fb66b5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:34.112120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e4b74ff193840ae9b52656571fb66b5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:34.120325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e4b74ff193840ae9b52656571fb66b5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:34.132118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e4b74ff193840ae9b52656571fb66b5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:34.135453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e4b74ff193840ae9b52656571fb66b5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:34.217217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1349/2693] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:33 2022] DELETE /identity/v3/users/8e4b74ff193840ae9b52656571fb66b5 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:34.221786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849efc43-d26f-4d4e-b137-db348a31e949 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.222241 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849efc43-d26f-4d4e-b137-db348a31e949 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.222342 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849efc43-d26f-4d4e-b137-db348a31e949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.240552 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-849efc43-d26f-4d4e-b137-db348a31e949 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:34.241732 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-849efc43-d26f-4d4e-b137-db348a31e949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:34.300157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1345/2694] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:34.310272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.311752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:34.368473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c04b-0945-4937-a9d6-b956dbd2d472 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.372389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9907a-6aaf-4738-af57-e40654c9ee90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.373064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9907a-6aaf-4738-af57-e40654c9ee90 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.373349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9907a-6aaf-4738-af57-e40654c9ee90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.373623 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9907a-6aaf-4738-af57-e40654c9ee90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.382730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9907a-6aaf-4738-af57-e40654c9ee90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.384148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9907a-6aaf-4738-af57-e40654c9ee90 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.393462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1350/2695] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:34.886982 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849efc43-d26f-4d4e-b137-db348a31e949 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:34.888410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-849efc43-d26f-4d4e-b137-db348a31e949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:34.902405 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849efc43-d26f-4d4e-b137-db348a31e949 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:34.907223 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:34.907951 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:34.909012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:34.909154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] PATH_INFO: `/v3/projects/886a80da9147401994618cceff0180ea` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:34.910497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=886a80da9147401994618cceff0180ea)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:34.912430 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:34.921347 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:35.040967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886a80da9147401994618cceff0180ea', 'request_id': 'req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.047302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886a80da9147401994618cceff0180ea', 'request_id': 'req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.053462 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886a80da9147401994618cceff0180ea', 'request_id': 'req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.114856 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] The token cache is being invalidate because project 886a80da9147401994618cceff0180ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:35.115202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.115826 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.117466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1346/2696] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:34 2022] DELETE /identity/v3/projects/886a80da9147401994618cceff0180ea => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:35.121866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9907a-6aaf-4738-af57-e40654c9ee90 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:35.132743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9907a-6aaf-4738-af57-e40654c9ee90 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:35.141775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:35.193152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:35.194204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:35.194795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:35.195247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] PATH_INFO: `/v3/users/50c1e0c08a8d4170b52848411beac5dd` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:35.197054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50c1e0c08a8d4170b52848411beac5dd)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:35.199178 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:35.437869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50c1e0c08a8d4170b52848411beac5dd'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.438440 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50c1e0c08a8d4170b52848411beac5dd'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.445905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50c1e0c08a8d4170b52848411beac5dd'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.457542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50c1e0c08a8d4170b52848411beac5dd'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.458277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-398ff850-75c9-4684-82d3-1a403500692d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50c1e0c08a8d4170b52848411beac5dd'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:35.555586 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1351/2697] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:35 2022] DELETE /identity/v3/users/50c1e0c08a8d4170b52848411beac5dd => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:36.040629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:36.042106 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:36.056155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1bf5d-4ecb-4377-b347-c19ca25de0fe admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:36.120366 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:36.121253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.121540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.121818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] PATH_INFO: `/v3/projects/659a1c2a72364a16a5fb79f5b3cca7a9` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.123064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659a1c2a72364a16a5fb79f5b3cca7a9)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:36.125089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:36.237118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659a1c2a72364a16a5fb79f5b3cca7a9', 'request_id': 'req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:36.244305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659a1c2a72364a16a5fb79f5b3cca7a9', 'request_id': 'req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:36.249973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659a1c2a72364a16a5fb79f5b3cca7a9', 'request_id': 'req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:36.359323 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] The token cache is being invalidate because project 659a1c2a72364a16a5fb79f5b3cca7a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:36.359829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:36.366918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-e19e9ba3-062a-4f4a-9fb2-6005a7e37e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:36.366918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1347/2698] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:36 2022] DELETE /identity/v3/projects/659a1c2a72364a16a5fb79f5b3cca7a9 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:36.367371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0fb66-e68b-40f4-ba66-90bca6cbeb5c None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.367813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0fb66-e68b-40f4-ba66-90bca6cbeb5c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.367905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0fb66-e68b-40f4-ba66-90bca6cbeb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.408459 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-03e0fb66-e68b-40f4-ba66-90bca6cbeb5c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:36.409664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-03e0fb66-e68b-40f4-ba66-90bca6cbeb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:36.471213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1352/2699] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:36.480386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd932ff-52b0-4498-a25e-d952c9b570fb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.480763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd932ff-52b0-4498-a25e-d952c9b570fb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.481117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd932ff-52b0-4498-a25e-d952c9b570fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.500211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1dd932ff-52b0-4498-a25e-d952c9b570fb None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:36.501438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1dd932ff-52b0-4498-a25e-d952c9b570fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:36.510250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1348/2700] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:36.514455 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0fb66-e68b-40f4-ba66-90bca6cbeb5c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:36.525272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0fb66-e68b-40f4-ba66-90bca6cbeb5c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:36.529804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:36.530464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.530769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.531042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.531756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:36.532056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:36.533654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:36.547919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1353/2701] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:36.552389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd932ff-52b0-4498-a25e-d952c9b570fb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:36.562005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd932ff-52b0-4498-a25e-d952c9b570fb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:36.567224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61c807-ed6a-4567-894b-84dc7ad68f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:36.567971 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c807-ed6a-4567-894b-84dc7ad68f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.568253 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c807-ed6a-4567-894b-84dc7ad68f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.568529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c807-ed6a-4567-894b-84dc7ad68f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.569217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61c807-ed6a-4567-894b-84dc7ad68f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:36.571149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f61c807-ed6a-4567-894b-84dc7ad68f3d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:36.722600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:36.733093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1349/2702] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:59:36 2022] POST /identity/v3/projects => generated 363 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:36.734234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:36.740060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:36.745605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd476ce-b703-4a3d-bc0f-484e400441c9 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:36.803334 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2952025-f1fb-4ab3-b90c-3284fc5e2097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:36.804015 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2952025-f1fb-4ab3-b90c-3284fc5e2097 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.804302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2952025-f1fb-4ab3-b90c-3284fc5e2097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.804582 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2952025-f1fb-4ab3-b90c-3284fc5e2097 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.805324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2952025-f1fb-4ab3-b90c-3284fc5e2097 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:36.807240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2952025-f1fb-4ab3-b90c-3284fc5e2097 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:36.890115 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1354/2703] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:59:36 2022] POST /identity/v3/users => generated 282 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:36.894218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61c807-ed6a-4567-894b-84dc7ad68f3d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:36.905692 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61c807-ed6a-4567-894b-84dc7ad68f3d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:36.910453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a825f5-aa3a-4af4-81f2-66c85ab86750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:36.911303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a825f5-aa3a-4af4-81f2-66c85ab86750 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.911585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a825f5-aa3a-4af4-81f2-66c85ab86750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.911859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a825f5-aa3a-4af4-81f2-66c85ab86750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.912576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a825f5-aa3a-4af4-81f2-66c85ab86750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:36.914198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a825f5-aa3a-4af4-81f2-66c85ab86750 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:36.924388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1350/2704] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:36.928958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2952025-f1fb-4ab3-b90c-3284fc5e2097 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:36.938919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2952025-f1fb-4ab3-b90c-3284fc5e2097 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:36.944685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b947de6-9f2f-4f4a-8b92-3c4c65d38f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:36.945401 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947de6-9f2f-4f4a-8b92-3c4c65d38f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.945683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947de6-9f2f-4f4a-8b92-3c4c65d38f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.945957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b947de6-9f2f-4f4a-8b92-3c4c65d38f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.946714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b947de6-9f2f-4f4a-8b92-3c4c65d38f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:36.948292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b947de6-9f2f-4f4a-8b92-3c4c65d38f17 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:36.958810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1355/2705] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:36.963043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a825f5-aa3a-4af4-81f2-66c85ab86750 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:36.972888 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a825f5-aa3a-4af4-81f2-66c85ab86750 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:36.977641 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10882e9a-660a-4697-8f14-72eac5235d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:36.978549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10882e9a-660a-4697-8f14-72eac5235d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:36.978834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10882e9a-660a-4697-8f14-72eac5235d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:36.979113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10882e9a-660a-4697-8f14-72eac5235d90 admin admin] PATH_INFO: `/v3/projects/51dab2446a08450aa12b2d188d6441bf/users/40f6b372a80c4501b25b7b70b118f3d8/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:36.994444 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10882e9a-660a-4697-8f14-72eac5235d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51dab2446a08450aa12b2d188d6441bf, user_id=40f6b372a80c4501b25b7b70b118f3d8, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:36.997117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10882e9a-660a-4697-8f14-72eac5235d90 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:37.082465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1351/2706] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:36 2022] PUT /identity/v3/projects/51dab2446a08450aa12b2d188d6441bf/users/40f6b372a80c4501b25b7b70b118f3d8/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:37.092892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae9e9-a0dd-44ae-b231-75d5ad66cbbd None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.093177 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae9e9-a0dd-44ae-b231-75d5ad66cbbd None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.093448 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ae9e9-a0dd-44ae-b231-75d5ad66cbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.121168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-396ae9e9-a0dd-44ae-b231-75d5ad66cbbd None None] MFA Rules not processed for user `40f6b372a80c4501b25b7b70b118f3d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:37.122645 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-396ae9e9-a0dd-44ae-b231-75d5ad66cbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:37.195381 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1356/2707] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:37.196585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10882e9a-660a-4697-8f14-72eac5235d90 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:37.261541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10882e9a-660a-4697-8f14-72eac5235d90 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:37.266340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6d66-85d7-4ff1-b239-0de64398c3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:37.267075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6d66-85d7-4ff1-b239-0de64398c3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.267341 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6d66-85d7-4ff1-b239-0de64398c3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.267613 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c6d66-85d7-4ff1-b239-0de64398c3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.268302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6d66-85d7-4ff1-b239-0de64398c3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:37.270494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c6d66-85d7-4ff1-b239-0de64398c3f1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:37.369305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1352/2708] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:59:37 2022] POST /identity/v3/projects => generated 363 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:37.373509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae9e9-a0dd-44ae-b231-75d5ad66cbbd None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:37.384939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ae9e9-a0dd-44ae-b231-75d5ad66cbbd None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:37.445400 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228679c5-592b-4f56-aea1-562156329c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:37.445994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228679c5-592b-4f56-aea1-562156329c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.446276 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228679c5-592b-4f56-aea1-562156329c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.446584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228679c5-592b-4f56-aea1-562156329c1a admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.447281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228679c5-592b-4f56-aea1-562156329c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:37.449205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228679c5-592b-4f56-aea1-562156329c1a admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:37.533773 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:37.540307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1357/2709] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:59:37 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:37.544374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6d66-85d7-4ff1-b239-0de64398c3f1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:37.555953 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c6d66-85d7-4ff1-b239-0de64398c3f1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:37.563003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ff9bd-1f27-4c21-bac1-325d3078a94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:37.563675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff9bd-1f27-4c21-bac1-325d3078a94f admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.563956 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff9bd-1f27-4c21-bac1-325d3078a94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.564227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ff9bd-1f27-4c21-bac1-325d3078a94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.564946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ff9bd-1f27-4c21-bac1-325d3078a94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:37.566541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ff9bd-1f27-4c21-bac1-325d3078a94f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:37.579682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1353/2710] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:37.584804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228679c5-592b-4f56-aea1-562156329c1a admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:37.595006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228679c5-592b-4f56-aea1-562156329c1a admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:37.600671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d0353-0993-44c8-b502-205689b24e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:37.604477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d0353-0993-44c8-b502-205689b24e19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.604477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d0353-0993-44c8-b502-205689b24e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.604477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d0353-0993-44c8-b502-205689b24e19 admin admin] PATH_INFO: `/v3/projects/a16e03b9326a4b82acdabe4e1ecd92fa/users/4238fc73ac714384b717a6d95ea80001/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.617482 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d0353-0993-44c8-b502-205689b24e19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16e03b9326a4b82acdabe4e1ecd92fa, user_id=4238fc73ac714384b717a6d95ea80001, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:37.620431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546d0353-0993-44c8-b502-205689b24e19 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:37.732426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1358/2711] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:37 2022] PUT /identity/v3/projects/a16e03b9326a4b82acdabe4e1ecd92fa/users/4238fc73ac714384b717a6d95ea80001/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:37.736438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ff9bd-1f27-4c21-bac1-325d3078a94f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:37.746762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ff9bd-1f27-4c21-bac1-325d3078a94f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:37.804497 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7634bbf1-8581-4549-a30a-1afd0a2bcf3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:37.805376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634bbf1-8581-4549-a30a-1afd0a2bcf3c admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.805651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634bbf1-8581-4549-a30a-1afd0a2bcf3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.805921 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7634bbf1-8581-4549-a30a-1afd0a2bcf3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.806659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634bbf1-8581-4549-a30a-1afd0a2bcf3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:37.808236 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7634bbf1-8581-4549-a30a-1afd0a2bcf3c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:37.818671 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1354/2712] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:37.822749 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d0353-0993-44c8-b502-205689b24e19 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:37.834122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d0353-0993-44c8-b502-205689b24e19 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:37.839186 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:37.840137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.840435 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.840708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] PATH_INFO: `/v3/projects/a16e03b9326a4b82acdabe4e1ecd92fa/users/4238fc73ac714384b717a6d95ea80001/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.842678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16e03b9326a4b82acdabe4e1ecd92fa, user_id=4238fc73ac714384b717a6d95ea80001, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:37.845604 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:37.856474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1359/2713] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:37 2022] PUT /identity/v3/projects/a16e03b9326a4b82acdabe4e1ecd92fa/users/4238fc73ac714384b717a6d95ea80001/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:37.867262 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab808870-4f7b-4cf5-a287-0e3d2d486aa5 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:37.867555 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab808870-4f7b-4cf5-a287-0e3d2d486aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:37.867836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab808870-4f7b-4cf5-a287-0e3d2d486aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:37.895532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-ab808870-4f7b-4cf5-a287-0e3d2d486aa5 None None] MFA Rules not processed for user `4238fc73ac714384b717a6d95ea80001`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:37.896784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ab808870-4f7b-4cf5-a287-0e3d2d486aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:37.916630 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:37.964275 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1355/2714] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:37.976193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:37.977839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:38.056438 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a357b6-e800-49ae-b0ab-80bdb096aca4 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:38.059986 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:38.060650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:38.060927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:38.061196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:38.070560 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:38.071962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:38.081356 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1360/2715] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:38.280438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab808870-4f7b-4cf5-a287-0e3d2d486aa5 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:38.290450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab808870-4f7b-4cf5-a287-0e3d2d486aa5 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:38.293962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624a269-00f2-490b-a4e7-2eb827502901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:38.294669 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624a269-00f2-490b-a4e7-2eb827502901 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:38.294955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624a269-00f2-490b-a4e7-2eb827502901 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:38.295226 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624a269-00f2-490b-a4e7-2eb827502901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:38.353564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624a269-00f2-490b-a4e7-2eb827502901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:38.354950 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624a269-00f2-490b-a4e7-2eb827502901 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:38.364403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1356/2716] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:38 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:38.735486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:38.736902 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:38.837775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09703a8e-3b3a-4939-9a20-c9aa5f2210ce service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:38.843491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef90c7c-9fcb-45a2-a9f9-2bdf8dfb7da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:38.844138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90c7c-9fcb-45a2-a9f9-2bdf8dfb7da2 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:38.844416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90c7c-9fcb-45a2-a9f9-2bdf8dfb7da2 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:38.844689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef90c7c-9fcb-45a2-a9f9-2bdf8dfb7da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:38.846537 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fef90c7c-9fcb-45a2-a9f9-2bdf8dfb7da2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:38.865369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90c7c-9fcb-45a2-a9f9-2bdf8dfb7da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:38.865369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef90c7c-9fcb-45a2-a9f9-2bdf8dfb7da2 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:38.879973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1361/2717] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:48.359879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=47 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:48.873897 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=96,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:52.670397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624a269-00f2-490b-a4e7-2eb827502901 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:52.733149 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624a269-00f2-490b-a4e7-2eb827502901 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:52.737695 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:52.738953 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:52.739238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:52.739516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] PATH_INFO: `/v3/users/40f6b372a80c4501b25b7b70b118f3d8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:52.740720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f6b372a80c4501b25b7b70b118f3d8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:52.742686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:52.963098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f6b372a80c4501b25b7b70b118f3d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:52.963673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f6b372a80c4501b25b7b70b118f3d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:52.964280 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f6b372a80c4501b25b7b70b118f3d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:52.976144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f6b372a80c4501b25b7b70b118f3d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:52.983151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f6b372a80c4501b25b7b70b118f3d8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:53.080757 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1357/2718] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:52 2022] DELETE /identity/v3/users/40f6b372a80c4501b25b7b70b118f3d8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:53.085904 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6715-63b2-442d-b4ba-60bf78ebe8e7 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:53.091837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6715-63b2-442d-b4ba-60bf78ebe8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:53.091837 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb6715-63b2-442d-b4ba-60bf78ebe8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:53.104244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9bcb6715-63b2-442d-b4ba-60bf78ebe8e7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:53.105429 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9bcb6715-63b2-442d-b4ba-60bf78ebe8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:53.164167 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1362/2719] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:53.173681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:53.175112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:53.232414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f17ca9-556c-478d-baa7-347c87bdacdb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:53.235905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558282-0601-4a92-8199-54c03a180119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:53.236544 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558282-0601-4a92-8199-54c03a180119 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:53.236825 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558282-0601-4a92-8199-54c03a180119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:53.237098 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558282-0601-4a92-8199-54c03a180119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:53.247183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558282-0601-4a92-8199-54c03a180119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:53.248602 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8558282-0601-4a92-8199-54c03a180119 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:53.258999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1358/2720] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:53.720371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb6715-63b2-442d-b4ba-60bf78ebe8e7 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:53.725792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9bcb6715-63b2-442d-b4ba-60bf78ebe8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:53.738007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb6715-63b2-442d-b4ba-60bf78ebe8e7 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:53.744139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:53.745043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:53.745390 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:53.745674 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] PATH_INFO: `/v3/projects/51dab2446a08450aa12b2d188d6441bf` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:53.746885 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51dab2446a08450aa12b2d188d6441bf)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:53.748857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:53.880281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51dab2446a08450aa12b2d188d6441bf', 'request_id': 'req-27fe14f5-52f0-4199-9800-eb5ba721d4e8'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:53.885673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51dab2446a08450aa12b2d188d6441bf', 'request_id': 'req-27fe14f5-52f0-4199-9800-eb5ba721d4e8'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:53.958739 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51dab2446a08450aa12b2d188d6441bf', 'request_id': 'req-27fe14f5-52f0-4199-9800-eb5ba721d4e8'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:53.969861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] The token cache is being invalidate because project 51dab2446a08450aa12b2d188d6441bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:53.970143 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:53.970800 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:53.972422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1363/2721] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:53 2022] DELETE /identity/v3/projects/51dab2446a08450aa12b2d188d6441bf => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:53.977493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558282-0601-4a92-8199-54c03a180119 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:53.987674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558282-0601-4a92-8199-54c03a180119 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:54.008848 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:54.048537 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:54.049329 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:54.049629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:54.049904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] PATH_INFO: `/v3/users/4238fc73ac714384b717a6d95ea80001` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:54.051697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4238fc73ac714384b717a6d95ea80001)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:54.053640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:54.262034 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4238fc73ac714384b717a6d95ea80001'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:54.262732 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4238fc73ac714384b717a6d95ea80001'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:54.263345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4238fc73ac714384b717a6d95ea80001'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:54.275901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4238fc73ac714384b717a6d95ea80001'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:54.283053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7fc8b827-ee86-49e4-b877-05b298d8f591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4238fc73ac714384b717a6d95ea80001'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:54.355054 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1359/2722] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:53 2022] DELETE /identity/v3/users/4238fc73ac714384b717a6d95ea80001 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:54.761853 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:54.763461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:54.777424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe14f5-52f0-4199-9800-eb5ba721d4e8 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:54.837103 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:54.837976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:54.838274 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:54.838571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] PATH_INFO: `/v3/projects/a16e03b9326a4b82acdabe4e1ecd92fa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:54.839752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16e03b9326a4b82acdabe4e1ecd92fa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:54.841647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:54.938808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:54.955119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16e03b9326a4b82acdabe4e1ecd92fa', 'request_id': 'req-bd0befcb-345e-4da0-86b2-d7562d445d44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:54.961428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16e03b9326a4b82acdabe4e1ecd92fa', 'request_id': 'req-bd0befcb-345e-4da0-86b2-d7562d445d44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:55.051794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16e03b9326a4b82acdabe4e1ecd92fa', 'request_id': 'req-bd0befcb-345e-4da0-86b2-d7562d445d44'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:55.062966 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] The token cache is being invalidate because project a16e03b9326a4b82acdabe4e1ecd92fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:55.063783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:55.063941 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-bd0befcb-345e-4da0-86b2-d7562d445d44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:55.065419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1364/2723] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:54 2022] DELETE /identity/v3/projects/a16e03b9326a4b82acdabe4e1ecd92fa => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:55.070898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10770fb3-e231-4da6-bf36-00017cece1e7 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.071366 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10770fb3-e231-4da6-bf36-00017cece1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.071495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10770fb3-e231-4da6-bf36-00017cece1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.090303 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-10770fb3-e231-4da6-bf36-00017cece1e7 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:55.091541 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-10770fb3-e231-4da6-bf36-00017cece1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:55.151168 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1360/2724] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:59:55.158791 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff239b2-e309-43c7-85a2-014f8b4339b9 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.159079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff239b2-e309-43c7-85a2-014f8b4339b9 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.159366 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff239b2-e309-43c7-85a2-014f8b4339b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.178285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-4ff239b2-e309-43c7-85a2-014f8b4339b9 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:55.179526 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4ff239b2-e309-43c7-85a2-014f8b4339b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:55.187521 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1365/2725] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:55.192267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10770fb3-e231-4da6-bf36-00017cece1e7 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:55.201725 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10770fb3-e231-4da6-bf36-00017cece1e7 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:55.206159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:55.207446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.207726 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.208003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.208731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:55.209031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:55.210642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:55.221880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1361/2726] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:55.226220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff239b2-e309-43c7-85a2-014f8b4339b9 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:55.235385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff239b2-e309-43c7-85a2-014f8b4339b9 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:55.240305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0318f-c112-4b4c-971f-a26da9903bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:55.240961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0318f-c112-4b4c-971f-a26da9903bc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.241241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0318f-c112-4b4c-971f-a26da9903bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.241513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0318f-c112-4b4c-971f-a26da9903bc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.242231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0318f-c112-4b4c-971f-a26da9903bc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:55.244454 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0318f-c112-4b4c-971f-a26da9903bc2 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:55.402794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1366/2727] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:59:55 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:59:55.406677 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:55.416880 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1127-4237-48cd-bae7-fef7d9f729eb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:55.443321 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:55.473976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c031-9d56-46fb-a9ae-944339d95a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:55.474679 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c031-9d56-46fb-a9ae-944339d95a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.474967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c031-9d56-46fb-a9ae-944339d95a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.475251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4514c031-9d56-46fb-a9ae-944339d95a4f admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.475954 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514c031-9d56-46fb-a9ae-944339d95a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:55.477868 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4514c031-9d56-46fb-a9ae-944339d95a4f admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:55.548570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1362/2728] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:59:55 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:59:55.553151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0318f-c112-4b4c-971f-a26da9903bc2 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:55.563272 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0318f-c112-4b4c-971f-a26da9903bc2 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:55.568484 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14418a-3bf6-405f-9f8b-015b936a9e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:55.569132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14418a-3bf6-405f-9f8b-015b936a9e34 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.569411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14418a-3bf6-405f-9f8b-015b936a9e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.569683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14418a-3bf6-405f-9f8b-015b936a9e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.570394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14418a-3bf6-405f-9f8b-015b936a9e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:55.571998 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14418a-3bf6-405f-9f8b-015b936a9e34 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:55.582520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1367/2729] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:55.586434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c031-9d56-46fb-a9ae-944339d95a4f admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:55.597537 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4514c031-9d56-46fb-a9ae-944339d95a4f admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:55.602156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75983d5-62ea-4adf-b0a2-6e076ee99189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:55.605348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75983d5-62ea-4adf-b0a2-6e076ee99189 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.605348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75983d5-62ea-4adf-b0a2-6e076ee99189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.605348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75983d5-62ea-4adf-b0a2-6e076ee99189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.605348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75983d5-62ea-4adf-b0a2-6e076ee99189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:55.605731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75983d5-62ea-4adf-b0a2-6e076ee99189 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:55.616434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1363/2730] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:55.620743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14418a-3bf6-405f-9f8b-015b936a9e34 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:55.631514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14418a-3bf6-405f-9f8b-015b936a9e34 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:55.636134 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869009a1-eac7-4c55-a090-e6b911208c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:55.637008 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869009a1-eac7-4c55-a090-e6b911208c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.637289 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869009a1-eac7-4c55-a090-e6b911208c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.637561 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869009a1-eac7-4c55-a090-e6b911208c86 admin admin] PATH_INFO: `/v3/projects/a5c7acd090944c11bc3409c0624c1fa1/users/2832d6b624734314ba7f0d0c702555ff/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.652142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869009a1-eac7-4c55-a090-e6b911208c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c7acd090944c11bc3409c0624c1fa1, user_id=2832d6b624734314ba7f0d0c702555ff, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:55.654819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869009a1-eac7-4c55-a090-e6b911208c86 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:55.737772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1368/2731] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:55 2022] PUT /identity/v3/projects/a5c7acd090944c11bc3409c0624c1fa1/users/2832d6b624734314ba7f0d0c702555ff/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:55.748986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e71c-0a5c-4b78-9bd7-791cd5bd7f9f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.754507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e71c-0a5c-4b78-9bd7-791cd5bd7f9f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.754507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4e71c-0a5c-4b78-9bd7-791cd5bd7f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.777540 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-95b4e71c-0a5c-4b78-9bd7-791cd5bd7f9f None None] MFA Rules not processed for user `2832d6b624734314ba7f0d0c702555ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:55.778799 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-95b4e71c-0a5c-4b78-9bd7-791cd5bd7f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:55.842978 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1364/2732] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:55.847996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869009a1-eac7-4c55-a090-e6b911208c86 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:55.911753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869009a1-eac7-4c55-a090-e6b911208c86 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:55.916345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c6e9c-24d6-464e-8329-3f194525edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:55.916994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c6e9c-24d6-464e-8329-3f194525edf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:55.917270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c6e9c-24d6-464e-8329-3f194525edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:55.917538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9c6e9c-24d6-464e-8329-3f194525edf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:55.918216 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c6e9c-24d6-464e-8329-3f194525edf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:55.920120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9c6e9c-24d6-464e-8329-3f194525edf8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:56.015794 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1369/2733] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:59:55 2022] POST /identity/v3/projects => generated 379 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:56.019514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4e71c-0a5c-4b78-9bd7-791cd5bd7f9f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:56.030538 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4e71c-0a5c-4b78-9bd7-791cd5bd7f9f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:56.086704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1270d-4744-429e-9f96-07379f663282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:56.087372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1270d-4744-429e-9f96-07379f663282 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:56.087657 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1270d-4744-429e-9f96-07379f663282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:56.087934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1270d-4744-429e-9f96-07379f663282 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:56.088633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1270d-4744-429e-9f96-07379f663282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:56.090564 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1270d-4744-429e-9f96-07379f663282 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:56.182131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1365/2734] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:59:56 2022] POST /identity/v3/users => generated 296 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 12:59:56.186093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c6e9c-24d6-464e-8329-3f194525edf8 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:56.196473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9c6e9c-24d6-464e-8329-3f194525edf8 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:56.201107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18585a-d5b4-4392-81f2-3c6e64748c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:56.201757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18585a-d5b4-4392-81f2-3c6e64748c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:56.202034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18585a-d5b4-4392-81f2-3c6e64748c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:56.202302 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18585a-d5b4-4392-81f2-3c6e64748c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:56.203108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18585a-d5b4-4392-81f2-3c6e64748c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:56.204678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18585a-d5b4-4392-81f2-3c6e64748c27 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:56.215363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1370/2735] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 12:59:56.220507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1270d-4744-429e-9f96-07379f663282 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:56.231103 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1270d-4744-429e-9f96-07379f663282 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:56.235843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184abb-910b-4eb6-bc85-c4922d2627c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:56.236736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184abb-910b-4eb6-bc85-c4922d2627c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:56.237043 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184abb-910b-4eb6-bc85-c4922d2627c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:56.237318 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15184abb-910b-4eb6-bc85-c4922d2627c8 admin admin] PATH_INFO: `/v3/projects/ad7dce916bd84ceab672e0fded370328/users/7a754e4bb1f2427cbf4b245b769a263b/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:56.252741 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184abb-910b-4eb6-bc85-c4922d2627c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7dce916bd84ceab672e0fded370328, user_id=7a754e4bb1f2427cbf4b245b769a263b, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:56.255441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15184abb-910b-4eb6-bc85-c4922d2627c8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:56.321257 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1366/2736] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:56 2022] PUT /identity/v3/projects/ad7dce916bd84ceab672e0fded370328/users/7a754e4bb1f2427cbf4b245b769a263b/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:56.325191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18585a-d5b4-4392-81f2-3c6e64748c27 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:56.335834 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18585a-d5b4-4392-81f2-3c6e64748c27 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:56.356292 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:56.392474 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58345088-baaf-4eed-8b96-815d5f671e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:56.393139 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58345088-baaf-4eed-8b96-815d5f671e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:56.393423 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58345088-baaf-4eed-8b96-815d5f671e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:56.393698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58345088-baaf-4eed-8b96-815d5f671e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:56.394996 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58345088-baaf-4eed-8b96-815d5f671e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:56.396578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58345088-baaf-4eed-8b96-815d5f671e5c admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:56.406210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1371/2737] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 12:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 12:59:56.411204 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184abb-910b-4eb6-bc85-c4922d2627c8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:56.416561 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:56.421797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15184abb-910b-4eb6-bc85-c4922d2627c8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:56.426455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:56.427471 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:56.427760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:56.428031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] PATH_INFO: `/v3/projects/ad7dce916bd84ceab672e0fded370328/users/7a754e4bb1f2427cbf4b245b769a263b/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:56.429970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad7dce916bd84ceab672e0fded370328, user_id=7a754e4bb1f2427cbf4b245b769a263b, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:56.432594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:56.442596 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1367/2738] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 12:59:56 2022] PUT /identity/v3/projects/ad7dce916bd84ceab672e0fded370328/users/7a754e4bb1f2427cbf4b245b769a263b/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:56.453520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f581-bfa1-4a4e-a61d-a0e2d4006b16 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:56.453811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f581-bfa1-4a4e-a61d-a0e2d4006b16 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:56.454119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f581-bfa1-4a4e-a61d-a0e2d4006b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:56.482156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-68c0f581-bfa1-4a4e-a61d-a0e2d4006b16 None None] MFA Rules not processed for user `7a754e4bb1f2427cbf4b245b769a263b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:56.483439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-68c0f581-bfa1-4a4e-a61d-a0e2d4006b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:56.552426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1372/2739] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 12:59:56.563532 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:56.565185 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:56.622361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d7f2c-22ca-4efa-aa05-6dfea8b2c2af admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:56.625930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481c930-d74e-497f-b25a-52ab942bc18f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:56.626591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c930-d74e-497f-b25a-52ab942bc18f service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:56.626875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c930-d74e-497f-b25a-52ab942bc18f service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:56.627146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c930-d74e-497f-b25a-52ab942bc18f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:56.636598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481c930-d74e-497f-b25a-52ab942bc18f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:56.638016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481c930-d74e-497f-b25a-52ab942bc18f service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:56.647690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1368/2740] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:57.191942 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0f581-bfa1-4a4e-a61d-a0e2d4006b16 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:57.253439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0f581-bfa1-4a4e-a61d-a0e2d4006b16 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:57.258797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:57.259676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:57.259956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:57.260227 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] PATH_INFO: `/v3/users/2832d6b624734314ba7f0d0c702555ff` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:57.261420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] RBAC: Authorizing `identity:delete_user(user_id=2832d6b624734314ba7f0d0c702555ff)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:57.263358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:57.485721 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2832d6b624734314ba7f0d0c702555ff'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:57.486373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2832d6b624734314ba7f0d0c702555ff'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:57.487585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:57.494077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2832d6b624734314ba7f0d0c702555ff'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:57.506516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2832d6b624734314ba7f0d0c702555ff'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:57.507187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2832d6b624734314ba7f0d0c702555ff'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:57.586809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1373/2741] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:57 2022] DELETE /identity/v3/users/2832d6b624734314ba7f0d0c702555ff => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:57.592021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf9848-8ecb-40b3-9750-0d55c805b8a0 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:57.592529 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf9848-8ecb-40b3-9750-0d55c805b8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:57.592807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf9848-8ecb-40b3-9750-0d55c805b8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:57.609838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-10bf9848-8ecb-40b3-9750-0d55c805b8a0 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:57.611062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-10bf9848-8ecb-40b3-9750-0d55c805b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:57.667830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1369/2742] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:57.677648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:57.679169 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:57.735714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952fd79-53e0-4efd-846f-cca0e2f217df admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:57.739939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688969be-e638-4aac-8d14-94dace896b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:57.740529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688969be-e638-4aac-8d14-94dace896b6e service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:57.740810 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688969be-e638-4aac-8d14-94dace896b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:57.741086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688969be-e638-4aac-8d14-94dace896b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:57.750270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688969be-e638-4aac-8d14-94dace896b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:57.751712 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688969be-e638-4aac-8d14-94dace896b6e service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:57.761619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1374/2743] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 12:59:58.232525 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf9848-8ecb-40b3-9750-0d55c805b8a0 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:58.235143 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-10bf9848-8ecb-40b3-9750-0d55c805b8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:58.255565 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf9848-8ecb-40b3-9750-0d55c805b8a0 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:58.263298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:58.264682 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:58.265170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:58.265664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] PATH_INFO: `/v3/projects/a5c7acd090944c11bc3409c0624c1fa1` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:58.267029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c7acd090944c11bc3409c0624c1fa1)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:58.269247 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:58.401212 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c7acd090944c11bc3409c0624c1fa1', 'request_id': 'req-1c5d5271-54c4-484b-9297-618b6ccfc817'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.407314 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c7acd090944c11bc3409c0624c1fa1', 'request_id': 'req-1c5d5271-54c4-484b-9297-618b6ccfc817'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.413425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c7acd090944c11bc3409c0624c1fa1', 'request_id': 'req-1c5d5271-54c4-484b-9297-618b6ccfc817'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.491804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] The token cache is being invalidate because project a5c7acd090944c11bc3409c0624c1fa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:58.492009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.492629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.494436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1370/2744] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:58 2022] DELETE /identity/v3/projects/a5c7acd090944c11bc3409c0624c1fa1 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:58.498453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688969be-e638-4aac-8d14-94dace896b6e service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:58.507886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688969be-e638-4aac-8d14-94dace896b6e service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:58.565738 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:58.566918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:58.567391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:58.567828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] PATH_INFO: `/v3/users/7a754e4bb1f2427cbf4b245b769a263b` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:58.569330 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a754e4bb1f2427cbf4b245b769a263b)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:58.571445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:58.797905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a754e4bb1f2427cbf4b245b769a263b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.798621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a754e4bb1f2427cbf4b245b769a263b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.806467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a754e4bb1f2427cbf4b245b769a263b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.817052 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:58.818921 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a754e4bb1f2427cbf4b245b769a263b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.819565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a0db93e4-1bce-49e8-81e2-eb23d3368cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a754e4bb1f2427cbf4b245b769a263b'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:58.920203 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1375/2745] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 12:59:58 2022] DELETE /identity/v3/users/7a754e4bb1f2427cbf4b245b769a263b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:59.356206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:59.357847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:59.371402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d5271-54c4-484b-9297-618b6ccfc817 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:59.388520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 12:59:59.434078 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:59.434973 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:59.435251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:59.435528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] PATH_INFO: `/v3/projects/ad7dce916bd84ceab672e0fded370328` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:59.436683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad7dce916bd84ceab672e0fded370328)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:59.438590 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:59.558091 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7dce916bd84ceab672e0fded370328', 'request_id': 'req-d002adda-399a-463e-8416-d686610bc8f7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:59.564102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7dce916bd84ceab672e0fded370328', 'request_id': 'req-d002adda-399a-463e-8416-d686610bc8f7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:59.569578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7dce916bd84ceab672e0fded370328', 'request_id': 'req-d002adda-399a-463e-8416-d686610bc8f7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:59.651523 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] The token cache is being invalidate because project ad7dce916bd84ceab672e0fded370328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 12:59:59.651833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:59.652439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-d002adda-399a-463e-8416-d686610bc8f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 12:59:59.653986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1371/2746] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 12:59:59 2022] DELETE /identity/v3/projects/ad7dce916bd84ceab672e0fded370328 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 12:59:59.658949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59e93-86e9-4b48-91e5-2200a326c0b8 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:59.659442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59e93-86e9-4b48-91e5-2200a326c0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:59.659547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a59e93-86e9-4b48-91e5-2200a326c0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:59.681231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-91a59e93-86e9-4b48-91e5-2200a326c0b8 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:59.682427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-91a59e93-86e9-4b48-91e5-2200a326c0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:59.741055 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1376/2747] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:59.749441 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2d00-8c4e-4c13-b9a8-ad24e0d46bfa None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:59.749730 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2d00-8c4e-4c13-b9a8-ad24e0d46bfa None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:59.750009 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c2d00-8c4e-4c13-b9a8-ad24e0d46bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:59.768992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3e4c2d00-8c4e-4c13-b9a8-ad24e0d46bfa None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 12:59:59.770786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3e4c2d00-8c4e-4c13-b9a8-ad24e0d46bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 12:59:59.778673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1372/2748] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 12:59:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 12:59:59.782731 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a59e93-86e9-4b48-91e5-2200a326c0b8 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:59.792505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a59e93-86e9-4b48-91e5-2200a326c0b8 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:59.797128 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:59.797779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:59.798056 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:59.798328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:59.799102 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 12:59:59.799407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:59.801196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:59.812804 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1377/2749] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 12:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 12:59:59.819654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c2d00-8c4e-4c13-b9a8-ad24e0d46bfa None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:59.829093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c2d00-8c4e-4c13-b9a8-ad24e0d46bfa None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 12:59:59.834157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ef851-36f2-4d5b-95f1-ea49de363488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 12:59:59.834844 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ef851-36f2-4d5b-95f1-ea49de363488 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 12:59:59.835129 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ef851-36f2-4d5b-95f1-ea49de363488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 12:59:59.835407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ef851-36f2-4d5b-95f1-ea49de363488 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 12:59:59.836120 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ef851-36f2-4d5b-95f1-ea49de363488 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 12:59:59.838017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ef851-36f2-4d5b-95f1-ea49de363488 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 12:59:59.934219 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1373/2750] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 12:59:59 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 12:59:59.938988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 12:59:59.949355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7317d6-123c-41e3-a2e5-5ff807d2396f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:00.006730 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba18bca-2488-4ddf-86ac-7c3fe1fc1023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:00.007397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba18bca-2488-4ddf-86ac-7c3fe1fc1023 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:00.007679 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba18bca-2488-4ddf-86ac-7c3fe1fc1023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:00.007954 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba18bca-2488-4ddf-86ac-7c3fe1fc1023 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:00.008637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba18bca-2488-4ddf-86ac-7c3fe1fc1023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:00.010549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba18bca-2488-4ddf-86ac-7c3fe1fc1023 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:00.085439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1378/2751] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 12:59:59 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:00:00.089631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ef851-36f2-4d5b-95f1-ea49de363488 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:00.101010 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ef851-36f2-4d5b-95f1-ea49de363488 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:00.105683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee7c0b-047c-4a6d-887e-c3840b47507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:00.106338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7c0b-047c-4a6d-887e-c3840b47507d admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:00.106652 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7c0b-047c-4a6d-887e-c3840b47507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:00.106930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee7c0b-047c-4a6d-887e-c3840b47507d admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:00.107647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee7c0b-047c-4a6d-887e-c3840b47507d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:00.109281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee7c0b-047c-4a6d-887e-c3840b47507d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:00.119959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1374/2752] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:00:00.123971 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba18bca-2488-4ddf-86ac-7c3fe1fc1023 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:00.134287 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba18bca-2488-4ddf-86ac-7c3fe1fc1023 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:00.138939 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b4f5d-137c-4478-a59d-e9dd50415d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:00.139593 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b4f5d-137c-4478-a59d-e9dd50415d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:00.139913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b4f5d-137c-4478-a59d-e9dd50415d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:00.140189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b4f5d-137c-4478-a59d-e9dd50415d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:00.140911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b4f5d-137c-4478-a59d-e9dd50415d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:00.142481 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2b4f5d-137c-4478-a59d-e9dd50415d05 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:00.153113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1379/2753] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:00:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:00:00.157263 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee7c0b-047c-4a6d-887e-c3840b47507d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:00.168230 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee7c0b-047c-4a6d-887e-c3840b47507d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:00.172923 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:00.173811 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:00.174094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:00.174374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] PATH_INFO: `/v3/projects/a21e626cfadc465daaa82c250170e634/users/2ecc22e627bb4108ad81ba2e69cb59a2/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:00.189665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21e626cfadc465daaa82c250170e634, user_id=2ecc22e627bb4108ad81ba2e69cb59a2, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:00.192948 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:00.264361 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1375/2754] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:00:00 2022] PUT /identity/v3/projects/a21e626cfadc465daaa82c250170e634/users/2ecc22e627bb4108ad81ba2e69cb59a2/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:00.275217 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbbb7a-8956-4af5-afa3-b9d8a1e9df05 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:00.275513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbbb7a-8956-4af5-afa3-b9d8a1e9df05 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:00.275793 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbbb7a-8956-4af5-afa3-b9d8a1e9df05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:00.303327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5dcbbb7a-8956-4af5-afa3-b9d8a1e9df05 None None] MFA Rules not processed for user `2ecc22e627bb4108ad81ba2e69cb59a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:00.304887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5dcbbb7a-8956-4af5-afa3-b9d8a1e9df05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:00.345396 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:00.368113 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1380/2755] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:00.379580 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:00.381324 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:00.427437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:00.438581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe3ea1-9b0f-4587-8655-194570a369f4 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:00.442842 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552b252-970c-47c0-bf43-2ccf04787507 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:00.443424 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b252-970c-47c0-bf43-2ccf04787507 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:00.443702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b252-970c-47c0-bf43-2ccf04787507 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:00.443979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552b252-970c-47c0-bf43-2ccf04787507 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:00.452022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552b252-970c-47c0-bf43-2ccf04787507 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:00.453425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552b252-970c-47c0-bf43-2ccf04787507 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:00.462841 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1376/2756] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:00:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:00:04.708159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbbb7a-8956-4af5-afa3-b9d8a1e9df05 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:04.770513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbbb7a-8956-4af5-afa3-b9d8a1e9df05 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:04.775171 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:04.776039 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:04.776322 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:04.776601 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] PATH_INFO: `/v3/users/2ecc22e627bb4108ad81ba2e69cb59a2` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:04.777775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecc22e627bb4108ad81ba2e69cb59a2)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:04.779736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:04.937376 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecc22e627bb4108ad81ba2e69cb59a2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:04.937961 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecc22e627bb4108ad81ba2e69cb59a2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:04.945029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecc22e627bb4108ad81ba2e69cb59a2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:04.956538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecc22e627bb4108ad81ba2e69cb59a2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:04.957165 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecc22e627bb4108ad81ba2e69cb59a2'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:05.020699 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1381/2757] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:00:04 2022] DELETE /identity/v3/users/2ecc22e627bb4108ad81ba2e69cb59a2 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:05.025307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1608df-4271-4be3-ab5d-c8f2fa0665dc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:05.025821 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1608df-4271-4be3-ab5d-c8f2fa0665dc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:05.025922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1608df-4271-4be3-ab5d-c8f2fa0665dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:05.043533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-9a1608df-4271-4be3-ab5d-c8f2fa0665dc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:05.044707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9a1608df-4271-4be3-ab5d-c8f2fa0665dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:05.101731 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1377/2758] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:05.111291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:05.112689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:05.170300 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ffa15-5a86-4670-9d99-cf5770eb6264 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:05.173896 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1994ede-72fa-4e9e-8f32-a8d6b4d240cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:05.174547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1994ede-72fa-4e9e-8f32-a8d6b4d240cc service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:05.174839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1994ede-72fa-4e9e-8f32-a8d6b4d240cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:05.175109 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1994ede-72fa-4e9e-8f32-a8d6b4d240cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:05.184802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1994ede-72fa-4e9e-8f32-a8d6b4d240cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:05.186213 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1994ede-72fa-4e9e-8f32-a8d6b4d240cc service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:05.195707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1382/2759] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:00:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:00:05.669231 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1608df-4271-4be3-ab5d-c8f2fa0665dc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:05.670174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9a1608df-4271-4be3-ab5d-c8f2fa0665dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:05.683845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1608df-4271-4be3-ab5d-c8f2fa0665dc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:05.688559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:05.689428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:05.690199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:05.690481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] PATH_INFO: `/v3/projects/a21e626cfadc465daaa82c250170e634` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:05.691876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21e626cfadc465daaa82c250170e634)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:05.693795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:05.801522 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21e626cfadc465daaa82c250170e634', 'request_id': 'req-8c8b399d-5595-4f2f-8982-534db3d4f853'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:05.808261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21e626cfadc465daaa82c250170e634', 'request_id': 'req-8c8b399d-5595-4f2f-8982-534db3d4f853'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:05.813979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21e626cfadc465daaa82c250170e634', 'request_id': 'req-8c8b399d-5595-4f2f-8982-534db3d4f853'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:05.888729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] The token cache is being invalidate because project a21e626cfadc465daaa82c250170e634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:00:05.889012 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:05.889620 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-8c8b399d-5595-4f2f-8982-534db3d4f853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:05.891211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1378/2760] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:00:05 2022] DELETE /identity/v3/projects/a21e626cfadc465daaa82c250170e634 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:05.896247 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14187b8-bf14-49c0-a204-ffecdf504d31 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:05.896734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14187b8-bf14-49c0-a204-ffecdf504d31 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:05.896833 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14187b8-bf14-49c0-a204-ffecdf504d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:05.904003 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:05.915744 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-a14187b8-bf14-49c0-a204-ffecdf504d31 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:05.916958 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a14187b8-bf14-49c0-a204-ffecdf504d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:05.976795 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1383/2761] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:05.985469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70980-fce8-49ca-8028-c392c82e754f None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:05.985750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70980-fce8-49ca-8028-c392c82e754f None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:05.986022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b70980-fce8-49ca-8028-c392c82e754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.006184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-52b70980-fce8-49ca-8028-c392c82e754f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:06.007469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-52b70980-fce8-49ca-8028-c392c82e754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:06.015353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1379/2762] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:06.019518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14187b8-bf14-49c0-a204-ffecdf504d31 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:06.030007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14187b8-bf14-49c0-a204-ffecdf504d31 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:06.034548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:06.035201 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:06.035477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:06.035748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.036551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:00:06.037505 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:06.039148 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:06.053933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1384/2763] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 13:00:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:00:06.055026 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70980-fce8-49ca-8028-c392c82e754f None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:06.064400 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b70980-fce8-49ca-8028-c392c82e754f None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:06.069269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244d46-0a7b-45ab-a5b1-b6451770a26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:06.069919 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244d46-0a7b-45ab-a5b1-b6451770a26c admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:06.070203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244d46-0a7b-45ab-a5b1-b6451770a26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:06.070483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244d46-0a7b-45ab-a5b1-b6451770a26c admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.071214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7244d46-0a7b-45ab-a5b1-b6451770a26c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:06.073112 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7244d46-0a7b-45ab-a5b1-b6451770a26c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:06.183121 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1380/2764] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:00:06 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:00:06.187375 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:06.197144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10028-6d7d-4af0-b39b-902d22607a94 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:06.259708 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9eb9-f623-4aef-ab2f-ad7f3e0f81c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:06.260391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9eb9-f623-4aef-ab2f-ad7f3e0f81c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:06.260676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9eb9-f623-4aef-ab2f-ad7f3e0f81c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:06.260955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9eb9-f623-4aef-ab2f-ad7f3e0f81c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.261661 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f9eb9-f623-4aef-ab2f-ad7f3e0f81c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:06.263733 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f9eb9-f623-4aef-ab2f-ad7f3e0f81c6 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:06.392760 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1385/2765] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:00:06 2022] POST /identity/v3/users => generated 285 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:00:06.397783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244d46-0a7b-45ab-a5b1-b6451770a26c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:06.408027 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244d46-0a7b-45ab-a5b1-b6451770a26c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:06.412673 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786447-bab5-48b9-a989-78d688139a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:06.413357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786447-bab5-48b9-a989-78d688139a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:06.413640 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786447-bab5-48b9-a989-78d688139a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:06.413917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2786447-bab5-48b9-a989-78d688139a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.414674 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2786447-bab5-48b9-a989-78d688139a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:06.416268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2786447-bab5-48b9-a989-78d688139a8c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:06.426691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1381/2766] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:00:06.430813 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9eb9-f623-4aef-ab2f-ad7f3e0f81c6 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:06.440695 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9eb9-f623-4aef-ab2f-ad7f3e0f81c6 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:06.445887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3499e0db-0eaf-4836-9968-11acf573b5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:06.446553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499e0db-0eaf-4836-9968-11acf573b5f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:06.446848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499e0db-0eaf-4836-9968-11acf573b5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:06.447119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3499e0db-0eaf-4836-9968-11acf573b5f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.447829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499e0db-0eaf-4836-9968-11acf573b5f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:06.449386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3499e0db-0eaf-4836-9968-11acf573b5f9 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:06.459747 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1386/2767] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:00:06.463632 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786447-bab5-48b9-a989-78d688139a8c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:06.473607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2786447-bab5-48b9-a989-78d688139a8c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:06.478123 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:06.479049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:06.479326 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:06.479593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] PATH_INFO: `/v3/projects/44fa41df6c494999a2051051646ad66c/users/d02c94bab93d45a1a00b648318351f54/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.494147 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44fa41df6c494999a2051051646ad66c, user_id=d02c94bab93d45a1a00b648318351f54, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:06.496817 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:06.581016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1382/2768] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:00:06 2022] PUT /identity/v3/projects/44fa41df6c494999a2051051646ad66c/users/d02c94bab93d45a1a00b648318351f54/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:00:06.596282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff717-64fa-48d1-917a-73fb84fb9da8 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:06.596569 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff717-64fa-48d1-917a-73fb84fb9da8 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:06.596841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aff717-64fa-48d1-917a-73fb84fb9da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.623346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-77aff717-64fa-48d1-917a-73fb84fb9da8 None None] MFA Rules not processed for user `d02c94bab93d45a1a00b648318351f54`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:06.624541 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-77aff717-64fa-48d1-917a-73fb84fb9da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:06.685154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:06.688651 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1387/2769] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:06.700746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:06.702606 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:06.709542 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:06.762049 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c1cc1-0a72-4f81-a68d-b64850dddc84 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:06.766776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a234224a-3cf7-4e4b-a4fe-6425eb08c0d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:06.767450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234224a-3cf7-4e4b-a4fe-6425eb08c0d0 service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:06.767729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234224a-3cf7-4e4b-a4fe-6425eb08c0d0 service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:06.768001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a234224a-3cf7-4e4b-a4fe-6425eb08c0d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:06.777325 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234224a-3cf7-4e4b-a4fe-6425eb08c0d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:06.778794 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a234224a-3cf7-4e4b-a4fe-6425eb08c0d0 service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:06.789376 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1383/2770] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:00:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:00:16.846238 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=24 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:44.566923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aff717-64fa-48d1-917a-73fb84fb9da8 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:44.631210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aff717-64fa-48d1-917a-73fb84fb9da8 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:44.635624 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:44.636490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:44.636769 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:44.637036 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] PATH_INFO: `/v3/users/d02c94bab93d45a1a00b648318351f54` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:44.638876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02c94bab93d45a1a00b648318351f54)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:44.640776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:44.853619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02c94bab93d45a1a00b648318351f54'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:44.854235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02c94bab93d45a1a00b648318351f54'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:44.861427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02c94bab93d45a1a00b648318351f54'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:44.874060 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02c94bab93d45a1a00b648318351f54'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:44.874727 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02c94bab93d45a1a00b648318351f54'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:44.940864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1388/2771] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:00:44 2022] DELETE /identity/v3/users/d02c94bab93d45a1a00b648318351f54 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:44.945423 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5d8e4-7303-4580-bfa4-31f563477683 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:44.945918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5d8e4-7303-4580-bfa4-31f563477683 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:44.946029 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5d8e4-7303-4580-bfa4-31f563477683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:44.964052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c9f5d8e4-7303-4580-bfa4-31f563477683 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:44.968021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c9f5d8e4-7303-4580-bfa4-31f563477683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:45.023419 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1384/2772] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:00:45.033243 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:45.034797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:45.092031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffea9727-e117-4d9b-8787-c6e7e964b186 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:45.095591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d5e8b-3443-4832-8de5-a2d9203a709e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:45.096244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d5e8b-3443-4832-8de5-a2d9203a709e service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:45.096518 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d5e8b-3443-4832-8de5-a2d9203a709e service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:45.097000 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d5e8b-3443-4832-8de5-a2d9203a709e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:45.106029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d5e8b-3443-4832-8de5-a2d9203a709e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:45.108229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d5e8b-3443-4832-8de5-a2d9203a709e service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:45.117615 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1389/2773] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:00:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:00:45.519097 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5d8e4-7303-4580-bfa4-31f563477683 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:45.520600 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c9f5d8e4-7303-4580-bfa4-31f563477683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:45.533201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5d8e4-7303-4580-bfa4-31f563477683 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:45.538181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:45.539096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:45.539368 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:45.539709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] PATH_INFO: `/v3/projects/44fa41df6c494999a2051051646ad66c` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:45.540941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] RBAC: Authorizing `identity:delete_project(project_id=44fa41df6c494999a2051051646ad66c)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:45.542865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:45.658834 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44fa41df6c494999a2051051646ad66c', 'request_id': 'req-6445c8ac-5a59-4a16-8cec-3b429b72992d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:45.665028 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44fa41df6c494999a2051051646ad66c', 'request_id': 'req-6445c8ac-5a59-4a16-8cec-3b429b72992d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:45.671408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44fa41df6c494999a2051051646ad66c', 'request_id': 'req-6445c8ac-5a59-4a16-8cec-3b429b72992d'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:45.762742 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] The token cache is being invalidate because project 44fa41df6c494999a2051051646ad66c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:00:45.763095 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:45.763992 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-6445c8ac-5a59-4a16-8cec-3b429b72992d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:00:45.765478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1385/2774] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:00:45 2022] DELETE /identity/v3/projects/44fa41df6c494999a2051051646ad66c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:45.771441 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b31b5-5bbf-4785-895b-8cf9490c8418 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:45.773377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b31b5-5bbf-4785-895b-8cf9490c8418 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:45.773377 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b31b5-5bbf-4785-895b-8cf9490c8418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:45.792162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-836b31b5-5bbf-4785-895b-8cf9490c8418 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:45.793362 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-836b31b5-5bbf-4785-895b-8cf9490c8418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:45.811822 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:45.855701 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1390/2775] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:00:45.865109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344247c-156a-4263-a665-b95be798562b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:45.865403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344247c-156a-4263-a665-b95be798562b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:45.865687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344247c-156a-4263-a665-b95be798562b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:45.886683 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-7344247c-156a-4263-a665-b95be798562b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:45.887960 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7344247c-156a-4263-a665-b95be798562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:45.896218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1386/2776] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:45.900370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b31b5-5bbf-4785-895b-8cf9490c8418 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:45.910229 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b31b5-5bbf-4785-895b-8cf9490c8418 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:45.914882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:45.915558 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:45.915844 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:45.916120 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:45.916836 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:00:45.917149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:45.918797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:45.930959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1391/2777] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 13:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:00:45.936214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344247c-156a-4263-a665-b95be798562b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:45.945436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344247c-156a-4263-a665-b95be798562b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:45.950025 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7f94-296d-453d-b7d9-001912d150f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:45.951227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7f94-296d-453d-b7d9-001912d150f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:45.951513 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7f94-296d-453d-b7d9-001912d150f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:45.951792 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca7f94-296d-453d-b7d9-001912d150f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:45.952487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7f94-296d-453d-b7d9-001912d150f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:45.954375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca7f94-296d-453d-b7d9-001912d150f3 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:46.036094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1387/2778] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:00:45 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:00:46.040241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:46.052488 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cbcee-cd93-494b-b349-32e7a723a83d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:46.112802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313af9e7-b6f8-4ee7-873e-81916d16bd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:46.113475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313af9e7-b6f8-4ee7-873e-81916d16bd2e admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:46.113756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313af9e7-b6f8-4ee7-873e-81916d16bd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:46.114029 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313af9e7-b6f8-4ee7-873e-81916d16bd2e admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:46.114753 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313af9e7-b6f8-4ee7-873e-81916d16bd2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:46.116640 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313af9e7-b6f8-4ee7-873e-81916d16bd2e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:46.222911 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1392/2779] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:00:46 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:00:46.226866 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7f94-296d-453d-b7d9-001912d150f3 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:46.238141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca7f94-296d-453d-b7d9-001912d150f3 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:46.242910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a110b7a-b10e-4e88-b9de-7301afec4dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:46.249240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a110b7a-b10e-4e88-b9de-7301afec4dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:46.249240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a110b7a-b10e-4e88-b9de-7301afec4dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:46.249240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a110b7a-b10e-4e88-b9de-7301afec4dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:46.249240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a110b7a-b10e-4e88-b9de-7301afec4dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:46.249240 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a110b7a-b10e-4e88-b9de-7301afec4dbf admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:46.259638 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1388/2780] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:00:46.264533 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313af9e7-b6f8-4ee7-873e-81916d16bd2e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:46.274771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313af9e7-b6f8-4ee7-873e-81916d16bd2e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:46.284209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ce61-c7ae-4de0-af69-9b3eb4e5a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:46.284924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ce61-c7ae-4de0-af69-9b3eb4e5a45f admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:46.285205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ce61-c7ae-4de0-af69-9b3eb4e5a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:46.285479 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ce61-c7ae-4de0-af69-9b3eb4e5a45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:46.286210 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253ce61-c7ae-4de0-af69-9b3eb4e5a45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:46.287889 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253ce61-c7ae-4de0-af69-9b3eb4e5a45f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:46.299033 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1393/2781] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:00:46.303109 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a110b7a-b10e-4e88-b9de-7301afec4dbf admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:46.313215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a110b7a-b10e-4e88-b9de-7301afec4dbf admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:46.317737 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:46.318658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:46.318937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:46.319209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] PATH_INFO: `/v3/projects/2bbaabf20652434cb79e0652ec678fbb/users/491ef95e936943d5a144876c2fe22eaf/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:46.335481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbaabf20652434cb79e0652ec678fbb, user_id=491ef95e936943d5a144876c2fe22eaf, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:46.338119 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:46.412220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1389/2782] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:00:46 2022] PUT /identity/v3/projects/2bbaabf20652434cb79e0652ec678fbb/users/491ef95e936943d5a144876c2fe22eaf/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:46.418796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae72da-9d0e-4ca5-82ca-369660d6a61b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:46.419894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae72da-9d0e-4ca5-82ca-369660d6a61b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:46.420578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae72da-9d0e-4ca5-82ca-369660d6a61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:46.439786 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-04ae72da-9d0e-4ca5-82ca-369660d6a61b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:46.441016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-04ae72da-9d0e-4ca5-82ca-369660d6a61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:46.504684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1394/2783] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:46.514851 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:46.516658 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:46.540724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:46.576840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04111143-b916-40ee-9bf5-aa0fa5308cec admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:46.581199 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584fa12-8fb8-4e92-bf76-41faa0408416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:46.581931 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584fa12-8fb8-4e92-bf76-41faa0408416 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:46.582215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584fa12-8fb8-4e92-bf76-41faa0408416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:46.582492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584fa12-8fb8-4e92-bf76-41faa0408416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:46.592390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584fa12-8fb8-4e92-bf76-41faa0408416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:46.593818 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b584fa12-8fb8-4e92-bf76-41faa0408416 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:46.603910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1390/2784] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:00:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:00:52.255876 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450550ce-932c-43bd-978d-d264c426f451 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:52.256399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450550ce-932c-43bd-978d-d264c426f451 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:52.256497 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450550ce-932c-43bd-978d-d264c426f451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:52.292328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-450550ce-932c-43bd-978d-d264c426f451 None None] MFA Rules not processed for user `491ef95e936943d5a144876c2fe22eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:52.293595 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-450550ce-932c-43bd-978d-d264c426f451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:52.315812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:52.369393 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1395/2785] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:00:52.374171 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584fa12-8fb8-4e92-bf76-41faa0408416 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:52.385134 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584fa12-8fb8-4e92-bf76-41faa0408416 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:52.390202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491fc3f-f752-4eb1-96fb-e6f549afd4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:52.390917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491fc3f-f752-4eb1-96fb-e6f549afd4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:52.391201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491fc3f-f752-4eb1-96fb-e6f549afd4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:52.391478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491fc3f-f752-4eb1-96fb-e6f549afd4c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:52.392201 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491fc3f-f752-4eb1-96fb-e6f549afd4c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:52.394092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491fc3f-f752-4eb1-96fb-e6f549afd4c1 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:52.475989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1391/2786] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:00:52 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:00:52.480281 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450550ce-932c-43bd-978d-d264c426f451 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:52.493141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450550ce-932c-43bd-978d-d264c426f451 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:52.553402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd19e60-4093-433f-bddf-0a5c3c3fa848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:52.554071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd19e60-4093-433f-bddf-0a5c3c3fa848 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:52.554350 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd19e60-4093-433f-bddf-0a5c3c3fa848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:52.554654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd19e60-4093-433f-bddf-0a5c3c3fa848 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:52.555360 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd19e60-4093-433f-bddf-0a5c3c3fa848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:52.557284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd19e60-4093-433f-bddf-0a5c3c3fa848 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:52.623591 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1396/2787] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:00:52 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:00:52.627568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491fc3f-f752-4eb1-96fb-e6f549afd4c1 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:52.638482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491fc3f-f752-4eb1-96fb-e6f549afd4c1 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:52.642959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d2c1-d56b-45ab-bcfb-11187c256547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:52.643615 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d2c1-d56b-45ab-bcfb-11187c256547 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:52.643894 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d2c1-d56b-45ab-bcfb-11187c256547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:52.644167 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5d2c1-d56b-45ab-bcfb-11187c256547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:52.644879 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5d2c1-d56b-45ab-bcfb-11187c256547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:52.646453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5d2c1-d56b-45ab-bcfb-11187c256547 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:52.658429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1392/2788] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:00:52.662650 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd19e60-4093-433f-bddf-0a5c3c3fa848 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:52.673001 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd19e60-4093-433f-bddf-0a5c3c3fa848 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:52.679751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50bc29-ed1e-4810-8ddb-c265ed14e9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:52.679751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50bc29-ed1e-4810-8ddb-c265ed14e9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:52.679751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50bc29-ed1e-4810-8ddb-c265ed14e9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:52.679751 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c50bc29-ed1e-4810-8ddb-c265ed14e9c3 admin admin] PATH_INFO: `/v3/projects/119bcfc13c6746198f8d39a93af55731/users/34ce93a717b748febc7be09a6c3f4f90/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:52.695694 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50bc29-ed1e-4810-8ddb-c265ed14e9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119bcfc13c6746198f8d39a93af55731, user_id=34ce93a717b748febc7be09a6c3f4f90, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:52.698478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c50bc29-ed1e-4810-8ddb-c265ed14e9c3 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:52.749574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1397/2789] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:00:52 2022] PUT /identity/v3/projects/119bcfc13c6746198f8d39a93af55731/users/34ce93a717b748febc7be09a6c3f4f90/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:52.753558 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d2c1-d56b-45ab-bcfb-11187c256547 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:52.764133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5d2c1-d56b-45ab-bcfb-11187c256547 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:52.819457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c442cf-9c4f-4ffc-92a9-42618b0a6684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:52.820135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c442cf-9c4f-4ffc-92a9-42618b0a6684 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:52.820420 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c442cf-9c4f-4ffc-92a9-42618b0a6684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:52.820698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c442cf-9c4f-4ffc-92a9-42618b0a6684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:52.821425 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c442cf-9c4f-4ffc-92a9-42618b0a6684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:52.823050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c442cf-9c4f-4ffc-92a9-42618b0a6684 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:52.833636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1393/2790] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:00:52.837918 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50bc29-ed1e-4810-8ddb-c265ed14e9c3 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:52.849209 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c50bc29-ed1e-4810-8ddb-c265ed14e9c3 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:52.853910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:52.854839 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:52.858547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:52.858547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] PATH_INFO: `/v3/projects/119bcfc13c6746198f8d39a93af55731/users/34ce93a717b748febc7be09a6c3f4f90/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:52.858547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=119bcfc13c6746198f8d39a93af55731, user_id=34ce93a717b748febc7be09a6c3f4f90, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:52.860050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:52.870639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1398/2791] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:00:52 2022] PUT /identity/v3/projects/119bcfc13c6746198f8d39a93af55731/users/34ce93a717b748febc7be09a6c3f4f90/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:00:58.474485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437107-1810-45e2-a0c6-47e56b0cd101 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:58.475014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437107-1810-45e2-a0c6-47e56b0cd101 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:58.475113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437107-1810-45e2-a0c6-47e56b0cd101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:58.507413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-24437107-1810-45e2-a0c6-47e56b0cd101 None None] MFA Rules not processed for user `34ce93a717b748febc7be09a6c3f4f90`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:00:58.508535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-24437107-1810-45e2-a0c6-47e56b0cd101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:58.577840 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1394/2792] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:00:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:00:58.594341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:00:58.596090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:00:58.675864 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e98ab17-5a8a-4dc6-b32a-d9595ad3dec0 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:00:58.681588 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:00:58.682309 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:00:58.682643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:00:58.682924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:00:58.690031 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:00:58.740244 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:00:58.741821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:00:58.751890 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1399/2793] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:00:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:01:08.574165 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:08.783017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=24 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:24.298599 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0efd7-8c8f-4b0a-be8e-5ec9b7120abb None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:24.299092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0efd7-8c8f-4b0a-be8e-5ec9b7120abb None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:24.299200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0efd7-8c8f-4b0a-be8e-5ec9b7120abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:24.317003 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-fad0efd7-8c8f-4b0a-be8e-5ec9b7120abb None None] MFA Rules not processed for user `491ef95e936943d5a144876c2fe22eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:01:24.318174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fad0efd7-8c8f-4b0a-be8e-5ec9b7120abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:24.324939 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1395/2794] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:01:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:01:26.824477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:26.825867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:26.915768 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f17a1-9725-46c4-a930-bb1a44cab547 service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:26.921017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:26.921702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:26.922016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:26.922291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:26.924067 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:26.939260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:26.940817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:26.951339 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1400/2795] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:01:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:01:29.921355 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0efd7-8c8f-4b0a-be8e-5ec9b7120abb None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:29.932666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-fad0efd7-8c8f-4b0a-be8e-5ec9b7120abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:29.967713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0efd7-8c8f-4b0a-be8e-5ec9b7120abb None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:29.973514 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:29.974296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:29.974608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:29.974965 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:29.977050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:29.992209 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:29.994369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:30.006786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1396/2796] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:01:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:01:36.947159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=41 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:40.001884 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=9 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:45.445057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:45.500027 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10172d-c58d-4801-b4ce-f96c9d07bd10 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:45.503630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:45.504301 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:45.505314 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:45.505665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:45.515066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:45.516528 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:45.526151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1401/2797] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:01:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:01:47.607455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:01:47.621534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e16fa-bc1a-4c91-86c2-5b150a9341d2 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:01:47.628585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:01:47.629380 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:01:47.629793 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:01:47.630567 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:01:47.632190 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:01:47.647410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:01:47.649146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:01:47.664809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1397/2798] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:01:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:01:55.521828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=26 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:01:57.659428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:02:45.186436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:02:45.186436 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:02:45.240086 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4297c-448a-424f-8399-62c1e87d295e service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:02:45.244132 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcc9060-a98d-4a7f-b052-483863b9ee47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:02:45.244772 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9060-a98d-4a7f-b052-483863b9ee47 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:02:45.245049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9060-a98d-4a7f-b052-483863b9ee47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:02:45.245320 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcc9060-a98d-4a7f-b052-483863b9ee47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:02:45.247066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-4dcc9060-a98d-4a7f-b052-483863b9ee47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:02:45.260894 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc9060-a98d-4a7f-b052-483863b9ee47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:02:45.262348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcc9060-a98d-4a7f-b052-483863b9ee47 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:02:45.273620 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1402/2799] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:02:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:02:49.186283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:02:49.187808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:02:49.199144 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e72d0a6-c86f-4a0e-af2f-567dc108e447 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:02:49.202695 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac42552-f4a1-4b27-91b3-1503e30d8e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:02:49.203330 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42552-f4a1-4b27-91b3-1503e30d8e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:02:49.204099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42552-f4a1-4b27-91b3-1503e30d8e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:02:49.204374 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac42552-f4a1-4b27-91b3-1503e30d8e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:02:49.206062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2ac42552-f4a1-4b27-91b3-1503e30d8e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:02:49.218906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42552-f4a1-4b27-91b3-1503e30d8e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:02:49.220936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac42552-f4a1-4b27-91b3-1503e30d8e50 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:02:49.231709 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1398/2800] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:02:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:02:55.268589 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=26 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:02:59.227055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:11.444637 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a383-71a4-45f6-8677-80d85bc49b70 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:04:11.445352 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a383-71a4-45f6-8677-80d85bc49b70 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:04:11.445352 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30a383-71a4-45f6-8677-80d85bc49b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:04:11.462635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5b30a383-71a4-45f6-8677-80d85bc49b70 None None] MFA Rules not processed for user `491ef95e936943d5a144876c2fe22eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:04:11.464658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5b30a383-71a4-45f6-8677-80d85bc49b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:04:11.471681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1403/2801] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:04:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:04:14.917107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be90c7-68aa-4f21-9235-766ade9cd726 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:04:14.917733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be90c7-68aa-4f21-9235-766ade9cd726 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:04:14.917733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be90c7-68aa-4f21-9235-766ade9cd726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:04:14.944403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-89be90c7-68aa-4f21-9235-766ade9cd726 None None] MFA Rules not processed for user `563aa380be524bc7970d486ce9ae82c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:04:14.945754 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-89be90c7-68aa-4f21-9235-766ade9cd726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:04:15.014933 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1399/2802] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:04:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:04:15.359627 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a383-71a4-45f6-8677-80d85bc49b70 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:04:15.370122 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30a383-71a4-45f6-8677-80d85bc49b70 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:04:15.378491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:04:15.379189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:04:15.379466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:04:15.379880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:04:15.381574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:04:15.392593 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:04:15.394023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:04:15.404342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1404/2803] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:04:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:04:23.590446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be90c7-68aa-4f21-9235-766ade9cd726 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:04:23.605364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be90c7-68aa-4f21-9235-766ade9cd726 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:04:23.611063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:04:23.611736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:04:23.612021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:04:23.612301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:04:23.614189 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:04:23.626665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:04:23.628283 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:04:23.639023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1400/2804] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:04:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:04:25.398873 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=9 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:32.717319 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:04:32.726372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02076c09-3287-4ee5-8b68-7711513bfb5f service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:04:32.730608 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e205f9-0f14-44d4-8454-c07187ea4522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:04:32.735546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e205f9-0f14-44d4-8454-c07187ea4522 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:04:32.735546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e205f9-0f14-44d4-8454-c07187ea4522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:04:32.735546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e205f9-0f14-44d4-8454-c07187ea4522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:04:32.735546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f9e205f9-0f14-44d4-8454-c07187ea4522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:04:32.744054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e205f9-0f14-44d4-8454-c07187ea4522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:04:32.746683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e205f9-0f14-44d4-8454-c07187ea4522 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:04:32.757701 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1405/2805] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:04:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:04:33.633770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=31 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:04:42.751899 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:24.004254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:24.005724 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:24.019867 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018063a2-6ed2-4486-9d35-1f4faaed0771 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:24.023521 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac40412-3387-425b-9b0f-fb033fb72465 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:24.028352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac40412-3387-425b-9b0f-fb033fb72465 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:24.028352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac40412-3387-425b-9b0f-fb033fb72465 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:24.028352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac40412-3387-425b-9b0f-fb033fb72465 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:24.034269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac40412-3387-425b-9b0f-fb033fb72465 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:24.035797 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac40412-3387-425b-9b0f-fb033fb72465 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:24.045720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1401/2806] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:34.040773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:36.731282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7a58c-009b-4bca-b6fc-51fa34991f32 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:36.731805 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7a58c-009b-4bca-b6fc-51fa34991f32 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:36.731908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c7a58c-009b-4bca-b6fc-51fa34991f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:36.749606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-55c7a58c-009b-4bca-b6fc-51fa34991f32 None None] MFA Rules not processed for user `491ef95e936943d5a144876c2fe22eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:36.750905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-55c7a58c-009b-4bca-b6fc-51fa34991f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:36.757686 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1406/2807] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:36.931254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac40412-3387-425b-9b0f-fb033fb72465 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:36.940910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac40412-3387-425b-9b0f-fb033fb72465 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:36.944429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:36.945068 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:36.945345 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:36.945623 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:36.948055 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:37.013438 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:37.015262 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:37.025365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1402/2808] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:37.873268 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7a58c-009b-4bca-b6fc-51fa34991f32 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:37.875374 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-55c7a58c-009b-4bca-b6fc-51fa34991f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:37.890267 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c7a58c-009b-4bca-b6fc-51fa34991f32 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:37.895442 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:37.896099 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:37.896379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:37.896654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:37.898424 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:37.911341 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:37.915410 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:37.924404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1407/2809] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:39.159470 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:39.171680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edffc5d-e184-4d5e-b322-d80645e30113 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:39.176761 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:39.177576 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:39.177690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:39.177953 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:39.187481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:39.189068 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:39.199417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1403/2810] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:40.533867 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:40.546434 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa2cd0-0f42-4ef4-acf8-11df7c1e1353 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:40.552849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:40.553523 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:40.553861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:40.554196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:40.556111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:40.572305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:40.574354 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:40.589532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1408/2811] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:40.938940 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:40.940666 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:40.959771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6215430e-0ef6-47bc-a7bd-7044cf201a72 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:40.965181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:40.966059 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:40.966339 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:40.966642 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] PATH_INFO: `/v3/users/563aa380be524bc7970d486ce9ae82c7` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:40.967886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=563aa380be524bc7970d486ce9ae82c7)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:40.969831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:41.128699 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563aa380be524bc7970d486ce9ae82c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.129349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563aa380be524bc7970d486ce9ae82c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.130007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563aa380be524bc7970d486ce9ae82c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.143019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563aa380be524bc7970d486ce9ae82c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.149862 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-35cd28b1-0cc8-4ad1-9cd6-540711428e4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563aa380be524bc7970d486ce9ae82c7'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.236102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1404/2812] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:06:40 2022] DELETE /identity/v3/users/563aa380be524bc7970d486ce9ae82c7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:41.598567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:41.608808 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66ba08-6a94-4a4a-98f6-702652a9a603 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:41.677687 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:41.678770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:41.679126 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:41.679465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] PATH_INFO: `/v3/projects/fcb152674fde4beebd5a106495b1ab2c` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:41.681421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb152674fde4beebd5a106495b1ab2c)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:41.684509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:41.812475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb152674fde4beebd5a106495b1ab2c', 'request_id': 'req-054ed9f3-3828-48a0-b803-4c42891f42e7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.819447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb152674fde4beebd5a106495b1ab2c', 'request_id': 'req-054ed9f3-3828-48a0-b803-4c42891f42e7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.925866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb152674fde4beebd5a106495b1ab2c', 'request_id': 'req-054ed9f3-3828-48a0-b803-4c42891f42e7'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.938780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] The token cache is being invalidate because project fcb152674fde4beebd5a106495b1ab2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:06:41.939141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.939850 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-054ed9f3-3828-48a0-b803-4c42891f42e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:41.941507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1409/2813] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:06:41 2022] DELETE /identity/v3/projects/fcb152674fde4beebd5a106495b1ab2c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:41.946353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a69c5-a1ce-4803-a215-91ad4ba0256b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:41.946886 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a69c5-a1ce-4803-a215-91ad4ba0256b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:41.946988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85a69c5-a1ce-4803-a215-91ad4ba0256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:41.966686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-e85a69c5-a1ce-4803-a215-91ad4ba0256b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:41.972298 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-e85a69c5-a1ce-4803-a215-91ad4ba0256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:42.028340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:42.051261 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1405/2814] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:42.053016 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5948de6-60de-4fec-b288-a25b04f6792c None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.053305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5948de6-60de-4fec-b288-a25b04f6792c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.053581 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5948de6-60de-4fec-b288-a25b04f6792c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.073787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-f5948de6-60de-4fec-b288-a25b04f6792c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:42.075035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-f5948de6-60de-4fec-b288-a25b04f6792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:42.083066 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1410/2815] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:42.087338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a69c5-a1ce-4803-a215-91ad4ba0256b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:42.098108 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85a69c5-a1ce-4803-a215-91ad4ba0256b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:42.103691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:42.104450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.104729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.105005 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.105733 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:06:42.106141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:42.108305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:42.121864 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1406/2816] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 13:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:06:42.126994 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5948de6-60de-4fec-b288-a25b04f6792c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:42.136831 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5948de6-60de-4fec-b288-a25b04f6792c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:42.141444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8acc06-8d9d-45d7-a40d-86dcac6c9c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:42.142093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8acc06-8d9d-45d7-a40d-86dcac6c9c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.142371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8acc06-8d9d-45d7-a40d-86dcac6c9c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.142678 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8acc06-8d9d-45d7-a40d-86dcac6c9c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.143378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8acc06-8d9d-45d7-a40d-86dcac6c9c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:42.145264 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8acc06-8d9d-45d7-a40d-86dcac6c9c00 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:42.248629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1411/2817] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:06:42 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:06:42.249758 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:42.266654 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f545c79-cebc-4ccb-ade3-3e2dcd7aee12 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:42.343609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20cba-c1e8-471b-9757-141ed647a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:42.344798 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20cba-c1e8-471b-9757-141ed647a0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.345269 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20cba-c1e8-471b-9757-141ed647a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.345873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf20cba-c1e8-471b-9757-141ed647a0ec admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.347002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf20cba-c1e8-471b-9757-141ed647a0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:42.349039 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf20cba-c1e8-471b-9757-141ed647a0ec admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:42.481403 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1407/2818] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:06:42 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:06:42.483223 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8acc06-8d9d-45d7-a40d-86dcac6c9c00 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:42.493527 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8acc06-8d9d-45d7-a40d-86dcac6c9c00 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:42.499516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb131860-6882-49e1-b37b-745efef6cacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:42.500392 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb131860-6882-49e1-b37b-745efef6cacf admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.500671 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb131860-6882-49e1-b37b-745efef6cacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.500949 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb131860-6882-49e1-b37b-745efef6cacf admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.501683 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb131860-6882-49e1-b37b-745efef6cacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:42.503346 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb131860-6882-49e1-b37b-745efef6cacf admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:42.514157 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1412/2819] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:42.518224 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20cba-c1e8-471b-9757-141ed647a0ec admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:42.529038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf20cba-c1e8-471b-9757-141ed647a0ec admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:42.534084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92736763-02a0-4867-b93d-a5f22e074784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:42.534783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736763-02a0-4867-b93d-a5f22e074784 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.535065 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736763-02a0-4867-b93d-a5f22e074784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.535344 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92736763-02a0-4867-b93d-a5f22e074784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.538694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92736763-02a0-4867-b93d-a5f22e074784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:42.538694 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92736763-02a0-4867-b93d-a5f22e074784 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:42.550463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1408/2820] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:42.554612 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb131860-6882-49e1-b37b-745efef6cacf admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:42.566221 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb131860-6882-49e1-b37b-745efef6cacf admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:42.570317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13dc8d-a526-4187-be8c-6fa95692fded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:42.571255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13dc8d-a526-4187-be8c-6fa95692fded admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.571542 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13dc8d-a526-4187-be8c-6fa95692fded admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.571821 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13dc8d-a526-4187-be8c-6fa95692fded admin admin] PATH_INFO: `/v3/projects/c9685560efa248839f19ef0d2c265558/users/2b6f91979bde4bbfb41636663d07ceb1/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.575973 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:42.588688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13dc8d-a526-4187-be8c-6fa95692fded admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9685560efa248839f19ef0d2c265558, user_id=2b6f91979bde4bbfb41636663d07ceb1, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:42.591486 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13dc8d-a526-4187-be8c-6fa95692fded admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:42.685198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1413/2821] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:06:42 2022] PUT /identity/v3/projects/c9685560efa248839f19ef0d2c265558/users/2b6f91979bde4bbfb41636663d07ceb1/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:42.696772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9107e5a-6d77-43dd-b07d-4dce3c05cfe3 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.697064 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9107e5a-6d77-43dd-b07d-4dce3c05cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.698252 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9107e5a-6d77-43dd-b07d-4dce3c05cfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.734391 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-f9107e5a-6d77-43dd-b07d-4dce3c05cfe3 None None] MFA Rules not processed for user `2b6f91979bde4bbfb41636663d07ceb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:42.735665 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-f9107e5a-6d77-43dd-b07d-4dce3c05cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:42.808142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1409/2822] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:42.812605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13dc8d-a526-4187-be8c-6fa95692fded admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:42.879048 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13dc8d-a526-4187-be8c-6fa95692fded admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:42.883868 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8727ac-2be8-4646-aab0-a6605c3ba686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:42.884551 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8727ac-2be8-4646-aab0-a6605c3ba686 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:42.884871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8727ac-2be8-4646-aab0-a6605c3ba686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:42.885181 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8727ac-2be8-4646-aab0-a6605c3ba686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:42.885891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8727ac-2be8-4646-aab0-a6605c3ba686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:42.887826 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8727ac-2be8-4646-aab0-a6605c3ba686 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:43.001357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1414/2823] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:06:42 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:06:43.005136 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9107e5a-6d77-43dd-b07d-4dce3c05cfe3 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:43.017667 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9107e5a-6d77-43dd-b07d-4dce3c05cfe3 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:43.069959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:43.083877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b17d55-489b-4f30-b9e5-c97310f9ad81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:43.084557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b17d55-489b-4f30-b9e5-c97310f9ad81 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:43.084833 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b17d55-489b-4f30-b9e5-c97310f9ad81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:43.085104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b17d55-489b-4f30-b9e5-c97310f9ad81 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:43.085803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b17d55-489b-4f30-b9e5-c97310f9ad81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:43.088274 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b17d55-489b-4f30-b9e5-c97310f9ad81 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:43.221511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1410/2824] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:06:43 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:06:43.225404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8727ac-2be8-4646-aab0-a6605c3ba686 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:43.236453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8727ac-2be8-4646-aab0-a6605c3ba686 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:43.240905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd9e6b-37f8-4e2f-8061-406e7435403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:43.241590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9e6b-37f8-4e2f-8061-406e7435403f admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:43.241866 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9e6b-37f8-4e2f-8061-406e7435403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:43.242136 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd9e6b-37f8-4e2f-8061-406e7435403f admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:43.242887 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd9e6b-37f8-4e2f-8061-406e7435403f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:43.244520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd9e6b-37f8-4e2f-8061-406e7435403f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:43.255506 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1415/2825] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:43.259700 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b17d55-489b-4f30-b9e5-c97310f9ad81 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:43.270865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b17d55-489b-4f30-b9e5-c97310f9ad81 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:43.276317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a1f1-1654-4372-94a3-7ce3e62590ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:43.277392 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a1f1-1654-4372-94a3-7ce3e62590ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:43.277678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a1f1-1654-4372-94a3-7ce3e62590ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:43.277959 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca8a1f1-1654-4372-94a3-7ce3e62590ad admin admin] PATH_INFO: `/v3/projects/91947672db0045148a7f4c0981c39475/users/23f79e86bf474063858cf52bfde00d19/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:43.297746 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8a1f1-1654-4372-94a3-7ce3e62590ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=91947672db0045148a7f4c0981c39475, user_id=23f79e86bf474063858cf52bfde00d19, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:43.300465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca8a1f1-1654-4372-94a3-7ce3e62590ad admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:43.382994 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1411/2826] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:06:43 2022] PUT /identity/v3/projects/91947672db0045148a7f4c0981c39475/users/23f79e86bf474063858cf52bfde00d19/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:43.387144 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd9e6b-37f8-4e2f-8061-406e7435403f admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:43.396997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd9e6b-37f8-4e2f-8061-406e7435403f admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:43.461507 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0845f57-4a67-40a6-99d4-2b337bce876f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:43.462193 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0845f57-4a67-40a6-99d4-2b337bce876f admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:43.462477 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0845f57-4a67-40a6-99d4-2b337bce876f admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:43.463905 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0845f57-4a67-40a6-99d4-2b337bce876f admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:43.464636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0845f57-4a67-40a6-99d4-2b337bce876f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:43.466220 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0845f57-4a67-40a6-99d4-2b337bce876f admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:43.476252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1416/2827] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 13:06:43.480729 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a1f1-1654-4372-94a3-7ce3e62590ad admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:43.491913 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca8a1f1-1654-4372-94a3-7ce3e62590ad admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:43.501031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:43.501949 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:43.502232 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:43.502512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] PATH_INFO: `/v3/projects/91947672db0045148a7f4c0981c39475/users/23f79e86bf474063858cf52bfde00d19/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:43.504520 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91947672db0045148a7f4c0981c39475, user_id=23f79e86bf474063858cf52bfde00d19, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:43.513159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:43.519736 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1412/2828] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:06:43 2022] PUT /identity/v3/projects/91947672db0045148a7f4c0981c39475/users/23f79e86bf474063858cf52bfde00d19/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:43.530741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d153-4438-439b-ba4b-a3a01c8fd917 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:43.530975 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d153-4438-439b-ba4b-a3a01c8fd917 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:43.531252 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63d153-4438-439b-ba4b-a3a01c8fd917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:43.557943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-9d63d153-4438-439b-ba4b-a3a01c8fd917 None None] MFA Rules not processed for user `23f79e86bf474063858cf52bfde00d19`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:43.559180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9d63d153-4438-439b-ba4b-a3a01c8fd917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:43.608378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:43.638908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1417/2829] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:43.651158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:43.653053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:43.721013 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb20c9f8-b3f1-4604-93d9-0a5ba5790266 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:43.724795 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fb06c-420a-4e32-84eb-af39e9f1fbbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:43.725446 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb06c-420a-4e32-84eb-af39e9f1fbbd service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:43.725728 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb06c-420a-4e32-84eb-af39e9f1fbbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:43.725999 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fb06c-420a-4e32-84eb-af39e9f1fbbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:43.736873 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fb06c-420a-4e32-84eb-af39e9f1fbbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:43.738348 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fb06c-420a-4e32-84eb-af39e9f1fbbd service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:43.749659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1413/2830] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:44.576717 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63d153-4438-439b-ba4b-a3a01c8fd917 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:44.640089 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63d153-4438-439b-ba4b-a3a01c8fd917 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:44.644535 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:44.645402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:44.645732 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:44.646034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] PATH_INFO: `/v3/users/2b6f91979bde4bbfb41636663d07ceb1` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:44.647225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6f91979bde4bbfb41636663d07ceb1)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:44.649270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:44.833532 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6f91979bde4bbfb41636663d07ceb1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:44.834344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6f91979bde4bbfb41636663d07ceb1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:44.844855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6f91979bde4bbfb41636663d07ceb1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:44.858784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6f91979bde4bbfb41636663d07ceb1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:44.859513 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6f91979bde4bbfb41636663d07ceb1'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:44.915323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1418/2831] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:06:44 2022] DELETE /identity/v3/users/2b6f91979bde4bbfb41636663d07ceb1 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:44.920659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b3c3-6135-4f7f-b6dd-1ddea1270fa8 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:44.921290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b3c3-6135-4f7f-b6dd-1ddea1270fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:44.921290 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274b3c3-6135-4f7f-b6dd-1ddea1270fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:44.939570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0274b3c3-6135-4f7f-b6dd-1ddea1270fa8 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:44.940804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0274b3c3-6135-4f7f-b6dd-1ddea1270fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:45.027743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1414/2832] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:45.037622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:45.039087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:45.100476 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40fa67-d227-497b-ba0d-94eb10704bf8 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:45.103976 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec610f-39e9-4ae5-bbd2-7235d3819928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:45.104618 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec610f-39e9-4ae5-bbd2-7235d3819928 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:45.104895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec610f-39e9-4ae5-bbd2-7235d3819928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:45.105164 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec610f-39e9-4ae5-bbd2-7235d3819928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:45.113882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec610f-39e9-4ae5-bbd2-7235d3819928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:45.115610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec610f-39e9-4ae5-bbd2-7235d3819928 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:45.125238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1419/2833] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:45.513597 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274b3c3-6135-4f7f-b6dd-1ddea1270fa8 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:45.515745 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0274b3c3-6135-4f7f-b6dd-1ddea1270fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:45.528664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274b3c3-6135-4f7f-b6dd-1ddea1270fa8 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:45.533568 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:45.534203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:45.534484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:45.534801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] PATH_INFO: `/v3/projects/c9685560efa248839f19ef0d2c265558` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:45.536002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9685560efa248839f19ef0d2c265558)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:45.537920 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:45.642681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:45.649807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9685560efa248839f19ef0d2c265558', 'request_id': 'req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:45.657749 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9685560efa248839f19ef0d2c265558', 'request_id': 'req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:45.667505 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9685560efa248839f19ef0d2c265558', 'request_id': 'req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:45.731591 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] The token cache is being invalidate because project c9685560efa248839f19ef0d2c265558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:06:45.731877 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:45.732519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:45.734180 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1415/2834] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:06:45 2022] DELETE /identity/v3/projects/c9685560efa248839f19ef0d2c265558 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:45.738345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec610f-39e9-4ae5-bbd2-7235d3819928 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:45.743218 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:45.749465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec610f-39e9-4ae5-bbd2-7235d3819928 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:45.804399 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:45.805273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:45.805554 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:45.805828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] PATH_INFO: `/v3/users/23f79e86bf474063858cf52bfde00d19` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:45.807792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f79e86bf474063858cf52bfde00d19)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:45.809734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:46.017988 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f79e86bf474063858cf52bfde00d19'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.018924 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f79e86bf474063858cf52bfde00d19'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.028498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f79e86bf474063858cf52bfde00d19'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.042689 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f79e86bf474063858cf52bfde00d19'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.043418 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-31c09da9-46fe-4eb1-a79f-eeb7ba872139 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f79e86bf474063858cf52bfde00d19'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.117702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1420/2835] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:06:45 2022] DELETE /identity/v3/users/23f79e86bf474063858cf52bfde00d19 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:46.560276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:46.562007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:46.576094 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ecd8e-3f67-4bdb-ad82-fe9a8744501c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:46.636292 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:46.637170 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:46.637490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:46.637713 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] PATH_INFO: `/v3/projects/91947672db0045148a7f4c0981c39475` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:46.638934 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] RBAC: Authorizing `identity:delete_project(project_id=91947672db0045148a7f4c0981c39475)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:46.640838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:46.795626 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91947672db0045148a7f4c0981c39475', 'request_id': 'req-7cee084b-c50f-40f7-8c2f-dc5913c4963c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.801963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91947672db0045148a7f4c0981c39475', 'request_id': 'req-7cee084b-c50f-40f7-8c2f-dc5913c4963c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.809291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91947672db0045148a7f4c0981c39475', 'request_id': 'req-7cee084b-c50f-40f7-8c2f-dc5913c4963c'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.911437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] The token cache is being invalidate because project 91947672db0045148a7f4c0981c39475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:06:46.911712 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.912315 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-7cee084b-c50f-40f7-8c2f-dc5913c4963c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:46.913846 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1416/2836] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:06:46 2022] DELETE /identity/v3/projects/91947672db0045148a7f4c0981c39475 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:06:46.919578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48517ca4-825b-4884-928c-671ed6e36215 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:46.920077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48517ca4-825b-4884-928c-671ed6e36215 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:46.920175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48517ca4-825b-4884-928c-671ed6e36215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:46.938487 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-48517ca4-825b-4884-928c-671ed6e36215 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:46.939781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-48517ca4-825b-4884-928c-671ed6e36215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:47.000944 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1421/2837] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:06:47.008639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d685-cecb-428a-ae61-c9c75c4bc5cc None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.008930 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d685-cecb-428a-ae61-c9c75c4bc5cc None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.009213 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05d685-cecb-428a-ae61-c9c75c4bc5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.028559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-1f05d685-cecb-428a-ae61-c9c75c4bc5cc None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:47.029781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-1f05d685-cecb-428a-ae61-c9c75c4bc5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:47.037829 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1417/2838] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:47.043583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48517ca4-825b-4884-928c-671ed6e36215 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:47.053545 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48517ca4-825b-4884-928c-671ed6e36215 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:47.058384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:47.059077 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.059363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.059639 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.060389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80389) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:06:47.060673 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:47.062270 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:47.075147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1422/2839] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 13:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 13:06:47.079550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05d685-cecb-428a-ae61-c9c75c4bc5cc None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:47.089410 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05d685-cecb-428a-ae61-c9c75c4bc5cc None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:47.094044 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cea81-f9a2-439b-88ef-a80ae0d4145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:47.094727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cea81-f9a2-439b-88ef-a80ae0d4145a admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.095017 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cea81-f9a2-439b-88ef-a80ae0d4145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.095281 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cea81-f9a2-439b-88ef-a80ae0d4145a admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.096000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cea81-f9a2-439b-88ef-a80ae0d4145a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:47.097881 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cea81-f9a2-439b-88ef-a80ae0d4145a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:47.236193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1418/2840] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:06:47 2022] POST /identity/v3/projects => generated 367 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:06:47.240323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:47.251629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc8bde-3322-4f47-816d-2316c4f3b9b7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:47.256955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:47.316725 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d945-ec1d-4b38-b813-e6b38c873c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:47.317420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d945-ec1d-4b38-b813-e6b38c873c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.317700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d945-ec1d-4b38-b813-e6b38c873c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.317968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3d945-ec1d-4b38-b813-e6b38c873c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.318803 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3d945-ec1d-4b38-b813-e6b38c873c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:47.320703 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3d945-ec1d-4b38-b813-e6b38c873c26 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:47.407026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1423/2841] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:06:47 2022] POST /identity/v3/users => generated 284 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:06:47.411177 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cea81-f9a2-439b-88ef-a80ae0d4145a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:47.422918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cea81-f9a2-439b-88ef-a80ae0d4145a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:47.427607 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f25b3d-929f-4c9e-bbe9-2be569ab5225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:47.428718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f25b3d-929f-4c9e-bbe9-2be569ab5225 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.428718 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f25b3d-929f-4c9e-bbe9-2be569ab5225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.431176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f25b3d-929f-4c9e-bbe9-2be569ab5225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.431176 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f25b3d-929f-4c9e-bbe9-2be569ab5225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:47.431396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f25b3d-929f-4c9e-bbe9-2be569ab5225 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:47.443352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1419/2842] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:47.447583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d945-ec1d-4b38-b813-e6b38c873c26 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:47.457688 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3d945-ec1d-4b38-b813-e6b38c873c26 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:47.462297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1817b82-c3cb-4b07-a1be-2c0fb5de3e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:47.463046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817b82-c3cb-4b07-a1be-2c0fb5de3e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.463321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817b82-c3cb-4b07-a1be-2c0fb5de3e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.463594 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1817b82-c3cb-4b07-a1be-2c0fb5de3e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.464343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1817b82-c3cb-4b07-a1be-2c0fb5de3e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:47.465913 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1817b82-c3cb-4b07-a1be-2c0fb5de3e79 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:47.475858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1424/2843] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:47.480672 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f25b3d-929f-4c9e-bbe9-2be569ab5225 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:47.490680 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f25b3d-929f-4c9e-bbe9-2be569ab5225 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:47.496516 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098220a-6fc6-4283-8178-d4f5283b812a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:47.497428 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098220a-6fc6-4283-8178-d4f5283b812a admin admin] REQUEST_METHOD: `PUT` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.497707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098220a-6fc6-4283-8178-d4f5283b812a admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.497979 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098220a-6fc6-4283-8178-d4f5283b812a admin admin] PATH_INFO: `/v3/projects/5018afa1a7d64581879eb58079d8b2d9/users/4071e5761b72435e8f0c407c45fdab45/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.512621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098220a-6fc6-4283-8178-d4f5283b812a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5018afa1a7d64581879eb58079d8b2d9, user_id=4071e5761b72435e8f0c407c45fdab45, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:47.515296 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098220a-6fc6-4283-8178-d4f5283b812a admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:47.517483 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:47.589928 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1420/2844] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:06:47 2022] PUT /identity/v3/projects/5018afa1a7d64581879eb58079d8b2d9/users/4071e5761b72435e8f0c407c45fdab45/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:47.601469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ce2dc-9571-4583-be2c-e50cec04b95b None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.601764 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ce2dc-9571-4583-be2c-e50cec04b95b None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.602050 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ce2dc-9571-4583-be2c-e50cec04b95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.630759 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-450ce2dc-9571-4583-be2c-e50cec04b95b None None] MFA Rules not processed for user `4071e5761b72435e8f0c407c45fdab45`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:47.631990 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-450ce2dc-9571-4583-be2c-e50cec04b95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:47.703923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1425/2845] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:47.708976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098220a-6fc6-4283-8178-d4f5283b812a admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:47.773582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098220a-6fc6-4283-8178-d4f5283b812a admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:47.778815 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad108e5-ec5a-43d4-a0e6-038e2972a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:47.779469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad108e5-ec5a-43d4-a0e6-038e2972a842 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.779743 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad108e5-ec5a-43d4-a0e6-038e2972a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.780016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad108e5-ec5a-43d4-a0e6-038e2972a842 admin admin] PATH_INFO: `/v3/projects` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.780698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad108e5-ec5a-43d4-a0e6-038e2972a842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:47.782601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad108e5-ec5a-43d4-a0e6-038e2972a842 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:47.890766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1421/2846] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:06:47 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:06:47.895080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ce2dc-9571-4583-be2c-e50cec04b95b None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:47.907285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ce2dc-9571-4583-be2c-e50cec04b95b None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:47.965146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2fc7d-3313-4eea-8e78-0e6a05d0050e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:47.965841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2fc7d-3313-4eea-8e78-0e6a05d0050e admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:47.966094 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2fc7d-3313-4eea-8e78-0e6a05d0050e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:47.966391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2fc7d-3313-4eea-8e78-0e6a05d0050e admin admin] PATH_INFO: `/v3/users` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:47.967123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2fc7d-3313-4eea-8e78-0e6a05d0050e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:47.969043 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2fc7d-3313-4eea-8e78-0e6a05d0050e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:48.063013 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1426/2847] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:06:47 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:06:48.067151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad108e5-ec5a-43d4-a0e6-038e2972a842 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:48.078145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad108e5-ec5a-43d4-a0e6-038e2972a842 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:48.082808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0859d-bdc8-4871-b5bf-0d4a2d049648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:48.083485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0859d-bdc8-4871-b5bf-0d4a2d049648 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:48.083765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0859d-bdc8-4871-b5bf-0d4a2d049648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:48.084040 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0859d-bdc8-4871-b5bf-0d4a2d049648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:48.084760 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0859d-bdc8-4871-b5bf-0d4a2d049648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:48.086386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0859d-bdc8-4871-b5bf-0d4a2d049648 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:48.098570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1422/2848] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:48.102916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2fc7d-3313-4eea-8e78-0e6a05d0050e admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:48.113187 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2fc7d-3313-4eea-8e78-0e6a05d0050e admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:48.118017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16ff2-d891-46ae-81ff-08158cb2ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:48.118947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16ff2-d891-46ae-81ff-08158cb2ef7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:48.119226 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16ff2-d891-46ae-81ff-08158cb2ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:48.119520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d16ff2-d891-46ae-81ff-08158cb2ef7b admin admin] PATH_INFO: `/v3/projects/16d7a6740443439b97d3e3e9e8d7a9e1/users/6d1c769fa5f1464a82cd048a29e2f328/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:48.122578 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:48.137643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d16ff2-d891-46ae-81ff-08158cb2ef7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d7a6740443439b97d3e3e9e8d7a9e1, user_id=6d1c769fa5f1464a82cd048a29e2f328, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:48.140566 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d16ff2-d891-46ae-81ff-08158cb2ef7b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:48.250197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1427/2849] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:06:48 2022] PUT /identity/v3/projects/16d7a6740443439b97d3e3e9e8d7a9e1/users/6d1c769fa5f1464a82cd048a29e2f328/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:48.254229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0859d-bdc8-4871-b5bf-0d4a2d049648 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:48.265243 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0859d-bdc8-4871-b5bf-0d4a2d049648 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:48.325512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68058bc-0e63-4c36-b7da-c287b0102a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:48.326200 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68058bc-0e63-4c36-b7da-c287b0102a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:48.326482 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68058bc-0e63-4c36-b7da-c287b0102a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:48.326802 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68058bc-0e63-4c36-b7da-c287b0102a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:48.327533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68058bc-0e63-4c36-b7da-c287b0102a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:48.329211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68058bc-0e63-4c36-b7da-c287b0102a93 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:48.341217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1423/2850] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:48.345536 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16ff2-d891-46ae-81ff-08158cb2ef7b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:48.356378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d16ff2-d891-46ae-81ff-08158cb2ef7b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:48.361005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:48.361903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:48.364483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:48.364483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] PATH_INFO: `/v3/projects/16d7a6740443439b97d3e3e9e8d7a9e1/users/6d1c769fa5f1464a82cd048a29e2f328/roles/07de3e1931ca4d799df8510428e181aa` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:48.364483 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d7a6740443439b97d3e3e9e8d7a9e1, user_id=6d1c769fa5f1464a82cd048a29e2f328, role_id=07de3e1931ca4d799df8510428e181aa)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:48.367156 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:48.381851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1428/2851] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:06:48 2022] PUT /identity/v3/projects/16d7a6740443439b97d3e3e9e8d7a9e1/users/6d1c769fa5f1464a82cd048a29e2f328/roles/07de3e1931ca4d799df8510428e181aa => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:48.397622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b881-49f6-4779-ba7d-5c4977505e31 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:48.397914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b881-49f6-4779-ba7d-5c4977505e31 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:48.398254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0b881-49f6-4779-ba7d-5c4977505e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:48.428997 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-44a0b881-49f6-4779-ba7d-5c4977505e31 None None] MFA Rules not processed for user `6d1c769fa5f1464a82cd048a29e2f328`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:48.430133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-44a0b881-49f6-4779-ba7d-5c4977505e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:48.489353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:48.510480 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1424/2852] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:48 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:48.522908 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:48.524706 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:48.591104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b047d4d-2d03-4870-aa5f-142903d8e662 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:48.594797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb7da-29a0-4f72-b12a-95db07130522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:48.595469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb7da-29a0-4f72-b12a-95db07130522 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:48.595746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb7da-29a0-4f72-b12a-95db07130522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:48.596018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beb7da-29a0-4f72-b12a-95db07130522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:48.606384 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beb7da-29a0-4f72-b12a-95db07130522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:48.607849 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beb7da-29a0-4f72-b12a-95db07130522 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:48.617665 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1429/2853] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:48.702914 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0b881-49f6-4779-ba7d-5c4977505e31 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:48.704349 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-44a0b881-49f6-4779-ba7d-5c4977505e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:48.717988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0b881-49f6-4779-ba7d-5c4977505e31 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:48.722145 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b593d-3ed3-40c6-8e91-89e422d9058e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:48.722836 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b593d-3ed3-40c6-8e91-89e422d9058e service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:48.723118 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b593d-3ed3-40c6-8e91-89e422d9058e service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:48.723397 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b593d-3ed3-40c6-8e91-89e422d9058e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:48.789096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b593d-3ed3-40c6-8e91-89e422d9058e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:48.790975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b593d-3ed3-40c6-8e91-89e422d9058e service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:48.801151 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1425/2854] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:06:53.920809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb7da-29a0-4f72-b12a-95db07130522 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:53.984815 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beb7da-29a0-4f72-b12a-95db07130522 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:53.989599 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:53.990504 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:53.990934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:53.991206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] PATH_INFO: `/v3/users/4071e5761b72435e8f0c407c45fdab45` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:53.992402 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4071e5761b72435e8f0c407c45fdab45)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:53.994357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:54.302984 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4071e5761b72435e8f0c407c45fdab45'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:54.304232 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4071e5761b72435e8f0c407c45fdab45'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:54.313145 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4071e5761b72435e8f0c407c45fdab45'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:54.328359 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4071e5761b72435e8f0c407c45fdab45'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:54.329098 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4071e5761b72435e8f0c407c45fdab45'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:54.330857 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:54.417475 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1430/2855] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:06:53 2022] DELETE /identity/v3/users/4071e5761b72435e8f0c407c45fdab45 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:54.421952 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ba5a-88ed-490f-add5-ce2aaa3d797b None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:54.422550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ba5a-88ed-490f-add5-ce2aaa3d797b None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:54.422550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566ba5a-88ed-490f-add5-ce2aaa3d797b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:54.441140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-8566ba5a-88ed-490f-add5-ce2aaa3d797b None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:54.442351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8566ba5a-88ed-490f-add5-ce2aaa3d797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:54.507770 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1426/2856] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:54.518583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:54.520123 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:54.578900 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466ee56a-ca6f-4576-b0cb-19f6eda1744b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:54.582405 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:54.583072 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:54.583357 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:54.583628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:54.592811 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:54.594236 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:54.603799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1431/2857] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:54.884082 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ba5a-88ed-490f-add5-ce2aaa3d797b None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:54.885639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-8566ba5a-88ed-490f-add5-ce2aaa3d797b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:54.967845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566ba5a-88ed-490f-add5-ce2aaa3d797b None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:54.973146 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:54.973859 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:54.974139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:54.974416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:54.976259 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:54.991089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:54.996882 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:54.998974 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:55.001778 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:55.009465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1427/2858] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:06:55.047202 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70985e62-e848-46ca-ad52-1ee7b8383f97 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:55.051914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:55.052820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:55.053097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:55.053371 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] PATH_INFO: `/v3/projects/5018afa1a7d64581879eb58079d8b2d9` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:55.054610 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5018afa1a7d64581879eb58079d8b2d9)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:55.057259 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:55.234799 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5018afa1a7d64581879eb58079d8b2d9', 'request_id': 'req-6839d426-0934-4d07-8d95-31d3e0b984bc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.240584 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5018afa1a7d64581879eb58079d8b2d9', 'request_id': 'req-6839d426-0934-4d07-8d95-31d3e0b984bc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.354163 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5018afa1a7d64581879eb58079d8b2d9', 'request_id': 'req-6839d426-0934-4d07-8d95-31d3e0b984bc'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.368057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] The token cache is being invalidate because project 5018afa1a7d64581879eb58079d8b2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:06:55.368343 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.369180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.371090 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1432/2859] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:06:54 2022] DELETE /identity/v3/projects/5018afa1a7d64581879eb58079d8b2d9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:55.375511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:55.386906 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bfe568-6f48-4c1c-a493-0d682b868e1e service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:55.400688 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=100 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:55.456465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:55.457592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:55.457989 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:55.458365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] PATH_INFO: `/v3/users/6d1c769fa5f1464a82cd048a29e2f328` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:55.460340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1c769fa5f1464a82cd048a29e2f328)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:55.462838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:55.621375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1c769fa5f1464a82cd048a29e2f328'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.622048 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1c769fa5f1464a82cd048a29e2f328'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.622704 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1c769fa5f1464a82cd048a29e2f328'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.636701 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1c769fa5f1464a82cd048a29e2f328'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.644260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-46e5661a-6282-4928-a00c-bf64ccb8b974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1c769fa5f1464a82cd048a29e2f328'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:55.708289 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1428/2860] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:06:55 2022] DELETE /identity/v3/users/6d1c769fa5f1464a82cd048a29e2f328 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:56.153734 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:56.155323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:56.170312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839d426-0934-4d07-8d95-31d3e0b984bc admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:56.231590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:56.232466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:56.232746 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:56.233023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] PATH_INFO: `/v3/projects/16d7a6740443439b97d3e3e9e8d7a9e1` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:56.234234 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d7a6740443439b97d3e3e9e8d7a9e1)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:56.236180 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:56.259431 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:56.335752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d7a6740443439b97d3e3e9e8d7a9e1', 'request_id': 'req-59190e22-2274-4581-a43e-ed7ae3e0cbb4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:56.341819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d7a6740443439b97d3e3e9e8d7a9e1', 'request_id': 'req-59190e22-2274-4581-a43e-ed7ae3e0cbb4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:56.459658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d7a6740443439b97d3e3e9e8d7a9e1', 'request_id': 'req-59190e22-2274-4581-a43e-ed7ae3e0cbb4'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:56.472389 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] The token cache is being invalidate because project 16d7a6740443439b97d3e3e9e8d7a9e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:06:56.472676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:56.473315 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-59190e22-2274-4581-a43e-ed7ae3e0cbb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:06:56.474901 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1433/2861] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:06:56 2022] DELETE /identity/v3/projects/16d7a6740443439b97d3e3e9e8d7a9e1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:56.480492 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b80a8a-9d58-4c80-8e1d-75c639865d13 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:56.481053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b80a8a-9d58-4c80-8e1d-75c639865d13 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:56.481053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b80a8a-9d58-4c80-8e1d-75c639865d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:56.500472 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-a3b80a8a-9d58-4c80-8e1d-75c639865d13 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:56.501857 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a3b80a8a-9d58-4c80-8e1d-75c639865d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:56.564937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1429/2862] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:56.574241 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5c41-4405-4881-b99e-32f3026e253e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:56.574543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5c41-4405-4881-b99e-32f3026e253e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:56.574835 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5c41-4405-4881-b99e-32f3026e253e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:56.594433 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-0bef5c41-4405-4881-b99e-32f3026e253e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:56.595681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-0bef5c41-4405-4881-b99e-32f3026e253e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:56.603980 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1434/2863] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:56.608386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b80a8a-9d58-4c80-8e1d-75c639865d13 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:56.619000 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b80a8a-9d58-4c80-8e1d-75c639865d13 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:56.624191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:56.624878 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:56.625156 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:56.625426 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:56.626155 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:06:56.626455 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:56.628198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:56.641388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1430/2864] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 13:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:06:56.645324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5c41-4405-4881-b99e-32f3026e253e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:56.655239 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5c41-4405-4881-b99e-32f3026e253e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:56.659982 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d32d4-d7b3-4b1b-93f3-741aff81f924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:56.660642 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d32d4-d7b3-4b1b-93f3-741aff81f924 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:56.660931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d32d4-d7b3-4b1b-93f3-741aff81f924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:56.661206 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d32d4-d7b3-4b1b-93f3-741aff81f924 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:56.661891 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d32d4-d7b3-4b1b-93f3-741aff81f924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:56.663802 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d32d4-d7b3-4b1b-93f3-741aff81f924 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:56.810855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1435/2865] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:06:56 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:06:56.825486 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:56.836434 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d16f9-cb08-4642-96a9-0f1b83f8dbd2 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:56.854668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:56.897547 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff06c-68ca-466f-87dd-92cdb021c502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:56.898313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff06c-68ca-466f-87dd-92cdb021c502 admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:56.898622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff06c-68ca-466f-87dd-92cdb021c502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:56.898901 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ff06c-68ca-466f-87dd-92cdb021c502 admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:56.899763 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ff06c-68ca-466f-87dd-92cdb021c502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:56.902202 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ff06c-68ca-466f-87dd-92cdb021c502 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:57.106569 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1431/2866] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:06:56 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:06:57.110514 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d32d4-d7b3-4b1b-93f3-741aff81f924 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:57.121787 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d32d4-d7b3-4b1b-93f3-741aff81f924 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:57.126370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e5a57-b610-497e-a9be-bd3faedee20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:57.130337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e5a57-b610-497e-a9be-bd3faedee20b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:57.130337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e5a57-b610-497e-a9be-bd3faedee20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:57.130337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e5a57-b610-497e-a9be-bd3faedee20b admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:57.130337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e5a57-b610-497e-a9be-bd3faedee20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:57.130337 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e5a57-b610-497e-a9be-bd3faedee20b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:57.141509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1436/2867] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:57.146218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff06c-68ca-466f-87dd-92cdb021c502 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:57.156592 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ff06c-68ca-466f-87dd-92cdb021c502 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:57.161193 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e85b3-b508-4a4b-8c10-12bbc19a1025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:57.161922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e85b3-b508-4a4b-8c10-12bbc19a1025 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:57.162311 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e85b3-b508-4a4b-8c10-12bbc19a1025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:57.162493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e85b3-b508-4a4b-8c10-12bbc19a1025 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:57.163317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e85b3-b508-4a4b-8c10-12bbc19a1025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:57.164963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e85b3-b508-4a4b-8c10-12bbc19a1025 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:57.176353 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1432/2868] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:06:57.184965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e5a57-b610-497e-a9be-bd3faedee20b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:57.195133 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e5a57-b610-497e-a9be-bd3faedee20b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:57.200010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:57.200881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:57.201159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:57.201432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] PATH_INFO: `/v3/projects/4cf355fdc9794bec8ea55b807573d39f/users/131c4b4131494fab9ecf0c8f0cf82551/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:57.217583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf355fdc9794bec8ea55b807573d39f, user_id=131c4b4131494fab9ecf0c8f0cf82551, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:57.228141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:57.377046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1437/2869] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:06:57 2022] PUT /identity/v3/projects/4cf355fdc9794bec8ea55b807573d39f/users/131c4b4131494fab9ecf0c8f0cf82551/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:06:57.389229 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9660-52c2-410b-ac86-3e61f7534aa2 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:57.389527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9660-52c2-410b-ac86-3e61f7534aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:57.389835 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae9660-52c2-410b-ac86-3e61f7534aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:57.418983 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-45ae9660-52c2-410b-ac86-3e61f7534aa2 None None] MFA Rules not processed for user `131c4b4131494fab9ecf0c8f0cf82551`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:06:57.420205 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45ae9660-52c2-410b-ac86-3e61f7534aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:57.490993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1433/2870] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:06:57.503286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:57.504968 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:57.583170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2c198-cda5-4d45-bfa8-79b5607361af admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:57.587420 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:57.588273 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:57.588547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:57.588820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:57.597291 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:57.598771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:57.608556 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1438/2871] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:06:58.152050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae9660-52c2-410b-ac86-3e61f7534aa2 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:06:58.153382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-45ae9660-52c2-410b-ac86-3e61f7534aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:58.212014 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae9660-52c2-410b-ac86-3e61f7534aa2 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:06:58.216058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:06:58.216970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:06:58.217413 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:06:58.217753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:06:58.219616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:06:58.268801 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:06:58.289463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:06:58.291088 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:06:58.301458 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1434/2872] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:06:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:07:00.708421 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:00.710460 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:00.754323 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:07:00.802886 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea0e856-a876-4ef4-bb79-401b9a52eb15 service glance] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:00.809331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba97792-2170-44e6-9a20-960617c5ccc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:00.809985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97792-2170-44e6-9a20-960617c5ccc4 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:00.810263 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97792-2170-44e6-9a20-960617c5ccc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:00.810552 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba97792-2170-44e6-9a20-960617c5ccc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:00.812407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-dba97792-2170-44e6-9a20-960617c5ccc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:00.825010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97792-2170-44e6-9a20-960617c5ccc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:00.826616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba97792-2170-44e6-9a20-960617c5ccc4 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:00.838106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1439/2873] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:07:08.587776 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=10 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:07:10.953959 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=22 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:07:23.531493 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:23.607573 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3013c1-cf88-4b3f-96cf-fd8f58561adf service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:23.612001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:23.612869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:23.613139 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:23.613409 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] PATH_INFO: `/v3/users/131c4b4131494fab9ecf0c8f0cf82551` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:23.614601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131c4b4131494fab9ecf0c8f0cf82551)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:23.616490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:23.863216 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131c4b4131494fab9ecf0c8f0cf82551'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:23.864451 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131c4b4131494fab9ecf0c8f0cf82551'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:23.864594 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131c4b4131494fab9ecf0c8f0cf82551'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:23.876860 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131c4b4131494fab9ecf0c8f0cf82551'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:23.883628 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131c4b4131494fab9ecf0c8f0cf82551'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:23.969774 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1435/2874] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:07:23 2022] DELETE /identity/v3/users/131c4b4131494fab9ecf0c8f0cf82551 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:07:23.974348 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905667bc-823b-4eeb-87a6-04ce4ed1d82f None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:23.974934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905667bc-823b-4eeb-87a6-04ce4ed1d82f None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:23.975076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905667bc-823b-4eeb-87a6-04ce4ed1d82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:23.995386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-905667bc-823b-4eeb-87a6-04ce4ed1d82f None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:07:23.996655 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-905667bc-823b-4eeb-87a6-04ce4ed1d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:24.060774 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1440/2875] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:07:24.072258 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:24.074215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:24.149887 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848449e-572c-4862-81fb-f328cf372036 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:24.154518 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b61cdc-21ca-440c-a955-2a920d8fa22e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:24.155203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61cdc-21ca-440c-a955-2a920d8fa22e service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:24.155481 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61cdc-21ca-440c-a955-2a920d8fa22e service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:24.155753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b61cdc-21ca-440c-a955-2a920d8fa22e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:24.165904 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b61cdc-21ca-440c-a955-2a920d8fa22e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:24.167800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b61cdc-21ca-440c-a955-2a920d8fa22e service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:24.177456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1436/2876] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:07:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:07:24.582458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905667bc-823b-4eeb-87a6-04ce4ed1d82f None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:24.591419 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-905667bc-823b-4eeb-87a6-04ce4ed1d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:24.598138 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905667bc-823b-4eeb-87a6-04ce4ed1d82f None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:24.603332 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:24.605351 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:24.605636 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:24.605907 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] PATH_INFO: `/v3/projects/4cf355fdc9794bec8ea55b807573d39f` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:24.607358 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf355fdc9794bec8ea55b807573d39f)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:24.609555 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:24.729985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf355fdc9794bec8ea55b807573d39f', 'request_id': 'req-170b2ef6-58c8-479c-8df6-ead47eacfa1d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:24.735616 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf355fdc9794bec8ea55b807573d39f', 'request_id': 'req-170b2ef6-58c8-479c-8df6-ead47eacfa1d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:24.809411 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf355fdc9794bec8ea55b807573d39f', 'request_id': 'req-170b2ef6-58c8-479c-8df6-ead47eacfa1d'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:24.821285 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] The token cache is being invalidate because project 4cf355fdc9794bec8ea55b807573d39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:07:24.824159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:24.824159 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-170b2ef6-58c8-479c-8df6-ead47eacfa1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:07:24.824540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1441/2877] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:07:24 2022] DELETE /identity/v3/projects/4cf355fdc9794bec8ea55b807573d39f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:07:24.829031 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009205e6-28d7-46c0-b706-77db8269de64 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:24.829522 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009205e6-28d7-46c0-b706-77db8269de64 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:24.829645 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009205e6-28d7-46c0-b706-77db8269de64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:24.847898 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-009205e6-28d7-46c0-b706-77db8269de64 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:07:24.849111 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-009205e6-28d7-46c0-b706-77db8269de64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:24.871476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:07:24.927182 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1437/2878] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:07:24.935909 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e60c5-ad21-4b52-baf4-ef243403f766 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:24.936265 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e60c5-ad21-4b52-baf4-ef243403f766 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:24.936546 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e60c5-ad21-4b52-baf4-ef243403f766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:24.957107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-814e60c5-ad21-4b52-baf4-ef243403f766 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:07:24.958326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-814e60c5-ad21-4b52-baf4-ef243403f766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:24.967017 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1442/2879] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:07:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:07:24.971352 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009205e6-28d7-46c0-b706-77db8269de64 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:24.982250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009205e6-28d7-46c0-b706-77db8269de64 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:24.986748 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:24.987406 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:24.987686 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:24.987961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:24.988675 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:07:24.988977 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:24.990621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:25.003479 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1438/2880] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 13:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:07:25.008342 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e60c5-ad21-4b52-baf4-ef243403f766 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:25.018045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e60c5-ad21-4b52-baf4-ef243403f766 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:25.022621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211da652-dfd2-46ac-b27a-2aff211061c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:25.023271 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da652-dfd2-46ac-b27a-2aff211061c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:25.023549 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da652-dfd2-46ac-b27a-2aff211061c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:25.023819 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211da652-dfd2-46ac-b27a-2aff211061c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:25.024525 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211da652-dfd2-46ac-b27a-2aff211061c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:25.027030 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211da652-dfd2-46ac-b27a-2aff211061c7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:25.148490 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1443/2881] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:07:25 2022] POST /identity/v3/projects => generated 369 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 13:07:25.153845 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:25.169130 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec9228-5b25-443a-8179-8853fbe0aafb admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:25.228662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648fca-35d0-448e-be23-d65ef356880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:25.229442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648fca-35d0-448e-be23-d65ef356880d admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:25.229771 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648fca-35d0-448e-be23-d65ef356880d admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:25.230099 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd648fca-35d0-448e-be23-d65ef356880d admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:25.231004 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd648fca-35d0-448e-be23-d65ef356880d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:25.233211 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd648fca-35d0-448e-be23-d65ef356880d admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:25.310813 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1439/2882] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:07:25 2022] POST /identity/v3/users => generated 285 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:07:25.314714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211da652-dfd2-46ac-b27a-2aff211061c7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:25.326152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211da652-dfd2-46ac-b27a-2aff211061c7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:25.330854 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae9b58-2774-4f12-bc70-709d2aa4c85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:25.331520 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae9b58-2774-4f12-bc70-709d2aa4c85b admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:25.331841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae9b58-2774-4f12-bc70-709d2aa4c85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:25.332116 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae9b58-2774-4f12-bc70-709d2aa4c85b admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:25.332861 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae9b58-2774-4f12-bc70-709d2aa4c85b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:25.334462 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae9b58-2774-4f12-bc70-709d2aa4c85b admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:25.345776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1444/2883] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:07:25.349839 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648fca-35d0-448e-be23-d65ef356880d admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:25.360875 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd648fca-35d0-448e-be23-d65ef356880d admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:25.365698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83815253-7845-48b7-8e99-3c6314af0cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:25.366370 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83815253-7845-48b7-8e99-3c6314af0cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:25.366687 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83815253-7845-48b7-8e99-3c6314af0cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:25.366967 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83815253-7845-48b7-8e99-3c6314af0cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:25.367691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83815253-7845-48b7-8e99-3c6314af0cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:25.370069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83815253-7845-48b7-8e99-3c6314af0cf0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:25.380975 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1440/2884] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:07:25.386010 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae9b58-2774-4f12-bc70-709d2aa4c85b admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:25.396378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae9b58-2774-4f12-bc70-709d2aa4c85b admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:25.401409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:25.402498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:25.402862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:25.403142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] PATH_INFO: `/v3/projects/5579cce2d2a646bd8731b988cf9bcb17/users/db433720d5624f7288bc6133259959a8/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:25.420841 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5579cce2d2a646bd8731b988cf9bcb17, user_id=db433720d5624f7288bc6133259959a8, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:25.423597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:25.483681 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1445/2885] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:07:25 2022] PUT /identity/v3/projects/5579cce2d2a646bd8731b988cf9bcb17/users/db433720d5624f7288bc6133259959a8/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:07:25.496519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c450a-d74e-4dac-866d-20df03103719 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:25.496808 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c450a-d74e-4dac-866d-20df03103719 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:25.497084 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c450a-d74e-4dac-866d-20df03103719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:25.524519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-3a0c450a-d74e-4dac-866d-20df03103719 None None] MFA Rules not processed for user `db433720d5624f7288bc6133259959a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:07:25.525740 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3a0c450a-d74e-4dac-866d-20df03103719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:25.591429 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1441/2886] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:07:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:07:25.603197 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:07:25.605481 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:07:25.629124 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:07:25.694903 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986435-588a-4ee3-bf19-f65a7ced4f0d admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:07:25.699297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b8719-afb2-4a08-9467-d0c752a47c01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:07:25.701104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8719-afb2-4a08-9467-d0c752a47c01 service glance] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:07:25.701104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8719-afb2-4a08-9467-d0c752a47c01 service glance] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:07:25.701104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b8719-afb2-4a08-9467-d0c752a47c01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:07:25.709406 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b8719-afb2-4a08-9467-d0c752a47c01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:07:25.710847 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b8719-afb2-4a08-9467-d0c752a47c01 service glance] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:07:25.720547 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1446/2887] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:07:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:07:35.588002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:07:35.721930 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=17 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:15.084128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c450a-d74e-4dac-866d-20df03103719 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:15.146142 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c450a-d74e-4dac-866d-20df03103719 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:15.150747 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:15.151629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:15.151902 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:15.152173 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] PATH_INFO: `/v3/users/db433720d5624f7288bc6133259959a8` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:15.153357 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] RBAC: Authorizing `identity:delete_user(user_id=db433720d5624f7288bc6133259959a8)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:15.155396 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:15.357803 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db433720d5624f7288bc6133259959a8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:15.358477 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db433720d5624f7288bc6133259959a8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:15.359105 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db433720d5624f7288bc6133259959a8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:15.372075 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db433720d5624f7288bc6133259959a8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:15.379790 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db433720d5624f7288bc6133259959a8'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:15.481448 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1442/2888] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:08:15 2022] DELETE /identity/v3/users/db433720d5624f7288bc6133259959a8 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:08:15.486235 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd4a20-1ec9-481c-b292-c2ab01477989 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:15.486809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd4a20-1ec9-481c-b292-c2ab01477989 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:15.486809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd4a20-1ec9-481c-b292-c2ab01477989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:15.504963 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-09bd4a20-1ec9-481c-b292-c2ab01477989 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:08:15.506162 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-09bd4a20-1ec9-481c-b292-c2ab01477989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:15.567916 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1447/2889] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:08:15.577765 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:15.579206 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:15.637708 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c62f13-1abf-4139-8063-161b0a56468c admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:15.641461 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b8298c-3520-47b3-b81b-a1ef7c876994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:15.642110 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8298c-3520-47b3-b81b-a1ef7c876994 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:15.642390 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8298c-3520-47b3-b81b-a1ef7c876994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:15.642691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b8298c-3520-47b3-b81b-a1ef7c876994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:15.651892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8298c-3520-47b3-b81b-a1ef7c876994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:15.653333 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b8298c-3520-47b3-b81b-a1ef7c876994 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:15.663222 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1443/2890] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:08:16.139175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd4a20-1ec9-481c-b292-c2ab01477989 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:16.141154 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-09bd4a20-1ec9-481c-b292-c2ab01477989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:16.154580 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd4a20-1ec9-481c-b292-c2ab01477989 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:16.159605 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:16.160573 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:16.160858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:16.161137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] PATH_INFO: `/v3/projects/5579cce2d2a646bd8731b988cf9bcb17` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:16.162461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5579cce2d2a646bd8731b988cf9bcb17)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:16.164565 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:16.315789 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5579cce2d2a646bd8731b988cf9bcb17', 'request_id': 'req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:16.321656 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5579cce2d2a646bd8731b988cf9bcb17', 'request_id': 'req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:16.415439 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5579cce2d2a646bd8731b988cf9bcb17', 'request_id': 'req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:16.428146 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] The token cache is being invalidate because project 5579cce2d2a646bd8731b988cf9bcb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:08:16.428422 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:16.429080 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-2eb2a2ea-2e9d-4235-8979-bfddd1a5591e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:08:16.430714 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1448/2891] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:08:16 2022] DELETE /identity/v3/projects/5579cce2d2a646bd8731b988cf9bcb17 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 13:08:16.435621 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35bd9-1627-4e55-b002-07542b0c98d1 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:16.436198 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35bd9-1627-4e55-b002-07542b0c98d1 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:16.436872 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e35bd9-1627-4e55-b002-07542b0c98d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:16.457381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-17e35bd9-1627-4e55-b002-07542b0c98d1 None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:08:16.458634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-17e35bd9-1627-4e55-b002-07542b0c98d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:16.478191 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:16.521697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1444/2892] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:08:16.530150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8e46-5c24-4bf9-9ea9-8b684d76901e None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:16.530780 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8e46-5c24-4bf9-9ea9-8b684d76901e None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:16.530893 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c8e46-5c24-4bf9-9ea9-8b684d76901e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:16.550104 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-b65c8e46-5c24-4bf9-9ea9-8b684d76901e None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:08:16.551280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b65c8e46-5c24-4bf9-9ea9-8b684d76901e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:16.559327 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1449/2893] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:08:16.574814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e35bd9-1627-4e55-b002-07542b0c98d1 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:16.574814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e35bd9-1627-4e55-b002-07542b0c98d1 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:16.579113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:16.579767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:16.580045 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:16.580317 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:16.581032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80388) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 13:08:16.581354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:16.583063 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:16.595436 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1445/2894] 10.222.0.60 () {58 vars in 1152 bytes} [Thu May 26 13:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 13:08:16.599648 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c8e46-5c24-4bf9-9ea9-8b684d76901e None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:16.608755 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c8e46-5c24-4bf9-9ea9-8b684d76901e None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:16.613395 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f33c4-24a8-4d0d-ae2e-e495fc106d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:16.614049 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f33c4-24a8-4d0d-ae2e-e495fc106d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:16.614328 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f33c4-24a8-4d0d-ae2e-e495fc106d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:16.614629 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f33c4-24a8-4d0d-ae2e-e495fc106d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:16.615326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f33c4-24a8-4d0d-ae2e-e495fc106d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:16.617468 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f33c4-24a8-4d0d-ae2e-e495fc106d22 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:16.705587 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1450/2895] 10.222.0.60 () {60 vars in 1152 bytes} [Thu May 26 13:08:16 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:08:16.713375 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:16.725922 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8334e9-8a90-4bef-b403-a931280036e8 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:16.789678 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e56ab-1526-4fa0-82d0-b8e5f619fdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:16.790343 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e56ab-1526-4fa0-82d0-b8e5f619fdcd admin admin] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:16.790656 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e56ab-1526-4fa0-82d0-b8e5f619fdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:16.790936 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e56ab-1526-4fa0-82d0-b8e5f619fdcd admin admin] PATH_INFO: `/v3/users` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:16.791629 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e56ab-1526-4fa0-82d0-b8e5f619fdcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:16.793601 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e56ab-1526-4fa0-82d0-b8e5f619fdcd admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:16.916338 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1446/2896] 10.222.0.60 () {60 vars in 1143 bytes} [Thu May 26 13:08:16 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 13:08:16.921141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f33c4-24a8-4d0d-ae2e-e495fc106d22 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:16.931829 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f33c4-24a8-4d0d-ae2e-e495fc106d22 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:16.937149 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db192e-dd8b-4873-8343-b7e48c595f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:16.937797 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db192e-dd8b-4873-8343-b7e48c595f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:16.938074 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db192e-dd8b-4873-8343-b7e48c595f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:16.938373 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db192e-dd8b-4873-8343-b7e48c595f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:16.939188 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db192e-dd8b-4873-8343-b7e48c595f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:16.940796 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db192e-dd8b-4873-8343-b7e48c595f30 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:16.952590 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1451/2897] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:08:16.957045 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e56ab-1526-4fa0-82d0-b8e5f619fdcd admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:16.967769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e56ab-1526-4fa0-82d0-b8e5f619fdcd admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:16.972364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e59bf7-38cc-4760-a46e-4e3bcda3fb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:16.973022 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59bf7-38cc-4760-a46e-4e3bcda3fb02 admin admin] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:16.973304 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59bf7-38cc-4760-a46e-4e3bcda3fb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:16.973578 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e59bf7-38cc-4760-a46e-4e3bcda3fb02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:16.974295 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e59bf7-38cc-4760-a46e-4e3bcda3fb02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:16.975984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e59bf7-38cc-4760-a46e-4e3bcda3fb02 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:16.987096 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1447/2898] 10.222.0.60 () {58 vars in 1121 bytes} [Thu May 26 13:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 13:08:16.991480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db192e-dd8b-4873-8343-b7e48c595f30 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:17.002865 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db192e-dd8b-4873-8343-b7e48c595f30 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:17.007480 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:17.008469 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:17.008777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:17.009093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] PATH_INFO: `/v3/projects/9b22744f23304e41b1c3a5d2bc0afdb9/users/d9fc5cfd0a50441c9fd9116a7b5c514a/roles/b6f4cd580a914b0aa8c3a237d63e5350` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:17.024111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b22744f23304e41b1c3a5d2bc0afdb9, user_id=d9fc5cfd0a50441c9fd9116a7b5c514a, role_id=b6f4cd580a914b0aa8c3a237d63e5350)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:17.026757 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:17.108407 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1452/2899] 10.222.0.60 () {60 vars in 1482 bytes} [Thu May 26 13:08:16 2022] PUT /identity/v3/projects/9b22744f23304e41b1c3a5d2bc0afdb9/users/d9fc5cfd0a50441c9fd9116a7b5c514a/roles/b6f4cd580a914b0aa8c3a237d63e5350 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:08:17.113608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b59e2c-04e9-44d5-89fa-6d928e4b971c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:17.113905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b59e2c-04e9-44d5-89fa-6d928e4b971c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:17.114183 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b59e2c-04e9-44d5-89fa-6d928e4b971c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:17.134838 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-82b59e2c-04e9-44d5-89fa-6d928e4b971c None None] MFA Rules not processed for user `bc7504a99e7249a395b2c1252117a52e`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:08:17.136052 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-82b59e2c-04e9-44d5-89fa-6d928e4b971c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:17.197775 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1448/2900] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:08:17.207628 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:17.209355 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:17.230983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:17.267828 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e00acb-11e5-4d2a-8006-17cb006fec73 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:17.271511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:17.272212 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:17.272516 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:17.272783 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:17.283034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:17.284461 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:17.294032 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1453/2901] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:08:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:08:18.739382 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf247e-bf13-4182-8491-3d7c44a4fc2c None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:18.746407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf247e-bf13-4182-8491-3d7c44a4fc2c None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:18.746407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf247e-bf13-4182-8491-3d7c44a4fc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:18.775021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-0ecf247e-bf13-4182-8491-3d7c44a4fc2c None None] MFA Rules not processed for user `d9fc5cfd0a50441c9fd9116a7b5c514a`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:08:18.782647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0ecf247e-bf13-4182-8491-3d7c44a4fc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:18.794386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:18.855404 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1449/2902] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:08:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:08:18.867593 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:18.869022 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:18.928630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d171-74ce-4b3c-ac41-c6a722348f1b service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:18.932228 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:18.932875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:18.933166 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:18.933445 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:18.941919 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:18.943365 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:18.952473 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1454/2903] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:08:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:08:21.825969 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875c14-ee5e-4361-9e26-7c4702801d47 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:21.826494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875c14-ee5e-4361-9e26-7c4702801d47 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:21.826494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875c14-ee5e-4361-9e26-7c4702801d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:21.844782 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-4b875c14-ee5e-4361-9e26-7c4702801d47 None None] MFA Rules not processed for user `d9fc5cfd0a50441c9fd9116a7b5c514a`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:08:21.845970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4b875c14-ee5e-4361-9e26-7c4702801d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:21.853174 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1450/2904] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:08:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:08:21.890922 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:21.892369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:21.948825 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c02ada-d131-4cdb-8196-2d8ce204e676 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:21.952529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:21.953492 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:21.953777 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:21.954045 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:21.955817 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:22.027985 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:22.029306 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:22.041076 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1455/2905] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:08:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:08:22.246389 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875c14-ee5e-4361-9e26-7c4702801d47 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:22.256327 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875c14-ee5e-4361-9e26-7c4702801d47 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:22.259828 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:22.260469 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:22.260768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:22.261038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:22.262944 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:22.274800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:22.276235 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:22.285453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1451/2906] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:08:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:08:23.711198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:08:23.712658 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:23.725428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a4a3e-f45f-4326-84b0-1ae378afb38c service glance] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:08:23.728983 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:08:23.732379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:08:23.732379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:08:23.732379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:08:23.732379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:08:23.743426 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:23.747633 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:08:23.749058 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:08:23.760842 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1456/2907] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:08:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:08:32.282690 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=28 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:08:33.777349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=3 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:09:56.663769 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:09:56.700593 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4d686-5f4c-460e-9af2-1c5fb5c67472 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:09:56.704453 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:09:56.705107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:09:56.705388 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:09:56.705661 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:09:56.707468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:09:56.738465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:09:56.740557 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:09:56.749855 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1452/2908] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:09:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:10:06.745305 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=27 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:24.539307 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:11:24.540872 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:11:24.647231 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6723fa-ff6b-4fc8-8358-f3732af4eb58 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:11:24.654397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:11:24.655119 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:11:24.655403 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:11:24.655680 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:11:24.657855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:11:24.739258 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:11:24.740895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:11:24.770260 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1457/2909] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:11:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:11:34.765046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=75 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:11:49.976616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:11:49.978047 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:11:50.078805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cff85-2bc1-47dc-b3e5-0f2c1977af6c service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:11:50.083946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:11:50.084639 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:11:50.084946 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:11:50.085214 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:11:50.087050 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:11:50.099963 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:11:50.101536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:11:50.113249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1453/2910] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:11:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:12:00.108113 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=41 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:17.774622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:13:17.803266 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838b7d1-d722-46ba-98d1-3903f928214c service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:13:17.806997 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039569b-51e2-4170-a16f-c6b16dcd4506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:13:17.807657 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039569b-51e2-4170-a16f-c6b16dcd4506 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:13:17.807925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039569b-51e2-4170-a16f-c6b16dcd4506 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:13:17.808196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039569b-51e2-4170-a16f-c6b16dcd4506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:13:17.817956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039569b-51e2-4170-a16f-c6b16dcd4506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:13:17.819417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039569b-51e2-4170-a16f-c6b16dcd4506 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:13:17.829912 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1458/2911] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:13:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:13:22.960301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:13:22.971411 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efef7b-000b-460e-ad52-da5ea58c3ca5 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:13:22.975377 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085afe-71a0-4022-a95f-9237de91375f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:13:22.976364 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085afe-71a0-4022-a95f-9237de91375f service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:13:22.976468 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085afe-71a0-4022-a95f-9237de91375f service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:13:22.976830 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085afe-71a0-4022-a95f-9237de91375f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:13:22.990024 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e085afe-71a0-4022-a95f-9237de91375f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:13:22.991616 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e085afe-71a0-4022-a95f-9237de91375f service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:13:23.004535 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1454/2912] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:13:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:13:24.109882 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039569b-51e2-4170-a16f-c6b16dcd4506 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:13:24.119752 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039569b-51e2-4170-a16f-c6b16dcd4506 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:13:24.124478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:13:24.125150 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:13:24.125428 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:13:24.125698 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:13:24.137242 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:13:24.138707 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:13:24.150290 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1459/2913] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:13:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:13:32.999227 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:13:34.145168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=16 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:15:02.683463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085afe-71a0-4022-a95f-9237de91375f service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:15:02.693301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085afe-71a0-4022-a95f-9237de91375f service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:15:02.697062 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:15:02.697697 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:15:02.697976 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:15:02.698250 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:15:02.706598 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:15:02.708407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:15:02.718495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1455/2914] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:15:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:15:12.714276 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:16:53.032297 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:16:53.034140 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:16:53.049018 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c3786-eab3-4506-a010-e60de3b17046 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:16:53.054205 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cd6e3-fa73-4f89-bde7-87fa62c210f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:16:53.054871 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd6e3-fa73-4f89-bde7-87fa62c210f8 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:16:53.055147 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd6e3-fa73-4f89-bde7-87fa62c210f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:16:53.055417 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cd6e3-fa73-4f89-bde7-87fa62c210f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:16:53.064851 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cd6e3-fa73-4f89-bde7-87fa62c210f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:16:53.066398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619cd6e3-fa73-4f89-bde7-87fa62c210f8 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:16:53.076425 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1460/2915] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:16:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:17:03.072092 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:17:19.599527 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:17:19.601079 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:17:19.627169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fbcb2c-c112-4946-ad1d-0912d0bc2cfd service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:17:19.630781 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:17:19.631563 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:17:19.631702 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:17:19.631972 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:17:19.641643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:17:19.649651 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:17:19.653800 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1456/2916] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:17:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:17:29.651218 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=11 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:19:19.733597 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cd6e3-fa73-4f89-bde7-87fa62c210f8 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:19:19.795855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cd6e3-fa73-4f89-bde7-87fa62c210f8 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:19:19.800108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:19:19.800761 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:19:19.801042 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:19:19.801317 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:19:19.803830 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:19:19.820560 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:19:19.822102 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:19:19.884159 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319cc53-9950-4e3b-b4e6-f2424c7c3427 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:19:19.888609 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564d4f3-2130-4d5d-bf00-cc10fd070cf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:19:19.889260 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d4f3-2130-4d5d-bf00-cc10fd070cf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:19:19.889546 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d4f3-2130-4d5d-bf00-cc10fd070cf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:19:19.889819 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4564d4f3-2130-4d5d-bf00-cc10fd070cf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:19:19.891955 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:19:19.893386 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:19:19.901007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564d4f3-2130-4d5d-bf00-cc10fd070cf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:19:19.903092 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4564d4f3-2130-4d5d-bf00-cc10fd070cf9 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:19:19.918084 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1461/2917] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:19:19.923870 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1457/2918] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:19:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:19:29.914914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=61 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:19:29.921307 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=30 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:20:08.656363 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:20:08.658097 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:20:08.760613 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c6301-6b53-48bf-b272-185a5d7828c5 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:20:08.764416 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:20:08.764948 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:20:08.765478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:20:08.765478 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:20:08.767895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:20:08.778019 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:20:08.780007 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:20:08.788754 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1462/2919] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:20:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:20:18.784659 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=35 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:19.911534 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564d4f3-2130-4d5d-bf00-cc10fd070cf9 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:21:19.924937 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4564d4f3-2130-4d5d-bf00-cc10fd070cf9 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:21:19.928820 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:21:19.929475 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:21:19.929806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:21:19.930032 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:21:19.931993 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:21:20.010634 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:21:20.012284 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:21:20.023876 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1458/2920] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:21:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:21:21.209685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:21:21.211305 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:21:21.222061 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508f695-0da8-4c85-adf7-87fd4413edb2 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:21:21.225644 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:21:21.226282 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:21:21.226654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:21:21.226933 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:21:21.229046 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:21:21.243011 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:21:21.244430 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:21:21.256630 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1463/2921] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:21:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:21:30.018550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=34 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:31.251622 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:21:57.962478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:21:58.079810 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c83a4-60e6-4950-942d-88eb5ed601fd service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:21:58.085087 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:21:58.088140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:21:58.088140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:21:58.088140 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:21:58.088500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:21:58.125001 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:21:58.127267 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:21:58.137643 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1459/2922] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:21:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:22:08.133187 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=63 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:22:20.401956 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:22:20.422583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a9cb2-c10d-4f5d-8203-7d12fdf2ef6d service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:22:20.426230 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:22:20.426934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:22:20.427467 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:22:20.428093 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:22:20.429643 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:22:20.514225 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:22:20.515702 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:22:20.534970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1464/2923] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:22:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:22:30.532071 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=46 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:24:20.880288 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:24:20.881805 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:24:20.930435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcdecd-278b-4406-8b05-27e56b13a209 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:24:20.936093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56995-efa6-45ca-9179-73f80d32606b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:24:20.936738 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56995-efa6-45ca-9179-73f80d32606b service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:24:20.937023 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56995-efa6-45ca-9179-73f80d32606b service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:24:20.937299 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b56995-efa6-45ca-9179-73f80d32606b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:24:20.945197 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b56995-efa6-45ca-9179-73f80d32606b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:24:20.946807 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b56995-efa6-45ca-9179-73f80d32606b service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:24:20.956195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1460/2924] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:24:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:24:30.951608 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=18 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:13.668943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:25:13.682255 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ad7dad-7a71-422a-86a6-344b6b610572 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:25:13.686176 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00aea5-96cf-4a37-addb-f49ff9a82a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:25:13.686875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00aea5-96cf-4a37-addb-f49ff9a82a1b service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:25:13.687179 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00aea5-96cf-4a37-addb-f49ff9a82a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:25:13.687522 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00aea5-96cf-4a37-addb-f49ff9a82a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:25:13.697921 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00aea5-96cf-4a37-addb-f49ff9a82a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:25:13.699447 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe00aea5-96cf-4a37-addb-f49ff9a82a1b service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:25:13.708606 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1465/2925] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:25:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:25:22.010435 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56995-efa6-45ca-9179-73f80d32606b service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:25:22.023157 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b56995-efa6-45ca-9179-73f80d32606b service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:25:22.028779 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:25:22.029437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:25:22.029720 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:25:22.029996 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:25:22.032007 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:25:22.057559 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:25:22.059188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:25:22.070437 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1461/2926] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:25:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:25:23.704444 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:25:32.065624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:20.750875 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00aea5-96cf-4a37-addb-f49ff9a82a1b service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:26:20.757295 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe00aea5-96cf-4a37-addb-f49ff9a82a1b service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:26:20.762879 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:26:20.763530 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:26:20.763812 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:26:20.764087 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:26:20.775869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:26:20.777303 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:26:20.789529 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1466/2927] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:26:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:26:21.894131 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:26:21.904918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57ccfa-1a5f-4ac7-97dd-4f971c05059c service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:26:21.908495 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:26:21.909117 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:26:21.909394 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:26:21.909664 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:26:21.921133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:26:21.922556 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:26:21.935175 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1462/2928] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:26:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:26:30.783583 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:31.928582 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:26:58.953647 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:26:58.955325 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:26:58.970240 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32afd1a-f4bf-4638-9295-65e2c5abecc4 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:26:58.975277 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:26:58.975925 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:26:58.976204 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:26:58.976509 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:26:58.985770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:26:58.987391 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:26:58.998379 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1467/2929] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:26:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:27:08.994111 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:27:20.623986 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:27:20.625783 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:27:20.642033 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923182d-a0c2-49c0-a48f-274d7253df6f service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:27:20.649917 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:27:20.650822 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:27:20.651107 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:27:20.651381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:27:20.662707 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:27:20.664847 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:27:20.674217 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1463/2930] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:27:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:27:30.670549 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:29:20.221947 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:29:20.223617 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:29:20.308660 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03d03-2f96-4572-a2fd-67163f7fbb0e service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:29:20.312458 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:29:20.313108 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:29:20.313397 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:29:20.313676 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:29:20.315574 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:29:20.395453 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:29:20.396881 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:29:20.417006 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1468/2931] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:29:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:29:30.414023 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=70 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:21.982500 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:31:21.984203 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:31:22.071984 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59e804-df38-42fa-ab15-01f6fe68c508 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:31:22.075624 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:31:22.076268 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:31:22.076550 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:31:22.076826 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:31:22.078727 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:31:22.149053 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:31:22.150484 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:31:22.161463 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1464/2932] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:31:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:31:23.264906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:31:23.266503 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:31:23.278296 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc81572-54d4-4ba7-b5ef-9d38800dff39 service cinder] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:31:23.282096 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:31:23.282779 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:31:23.283064 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:31:23.283336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:31:23.285895 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:31:23.300498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:31:23.301848 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:31:23.312962 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1469/2933] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:31:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:31:32.156457 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=63 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:31:33.307934 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:02.943773 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:32:02.945334 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:32:03.073237 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cb194-7429-4076-be68-8de190ac2f29 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:32:03.078302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:32:03.078970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:32:03.079249 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:32:03.079519 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:32:03.081360 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:32:03.092668 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:32:03.094220 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:32:03.104181 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1465/2934] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:32:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:32:13.099767 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=58 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:32:21.519775 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:32:21.563464 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118b48-a23f-47c2-858d-b0aa6d7978b1 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:32:21.568858 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:32:21.569500 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:32:21.569781 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:32:21.570053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:32:21.571923 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:32:21.653324 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:32:21.655820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:32:21.675068 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1470/2935] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:32:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:32:31.672137 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=55 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:35:20.721648 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:35:20.743768 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2bffd-d6d5-4784-90d7-1e0ade153f89 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:35:20.747378 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:35:20.748019 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:35:20.748301 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:35:20.748570 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:35:20.756905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:35:20.758316 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:35:20.767215 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1466/2936] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:35:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:35:30.763030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=11 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:37:05.925207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:37:05.937771 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a3262-c68e-4243-a0ea-53273b100889 service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:37:05.943685 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb571a9-3601-4f84-811d-112df2e34604 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:37:05.945729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb571a9-3601-4f84-811d-112df2e34604 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:37:05.945729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb571a9-3601-4f84-811d-112df2e34604 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:37:05.945729 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb571a9-3601-4f84-811d-112df2e34604 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:37:05.955155 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb571a9-3601-4f84-811d-112df2e34604 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:37:05.956756 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb571a9-3601-4f84-811d-112df2e34604 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:37:05.968496 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1471/2937] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:37:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:37:15.963491 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=6 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:37:21.790896 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:37:21.792536 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:37:21.807080 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d863e6-ef93-4605-afa5-7930f0633d1e service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:37:21.809442 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae236df-6ae9-404b-87af-da88b679dd35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:37:21.810150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae236df-6ae9-404b-87af-da88b679dd35 service cinder] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:37:21.810386 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae236df-6ae9-404b-87af-da88b679dd35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:37:21.810698 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae236df-6ae9-404b-87af-da88b679dd35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:37:21.823485 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae236df-6ae9-404b-87af-da88b679dd35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:37:21.825507 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae236df-6ae9-404b-87af-da88b679dd35 service cinder] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:37:21.837150 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1467/2938] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:37:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:37:31.831466 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=6 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:20.957762 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d95e94-5d83-46d8-8f6b-ea67cc5918a2 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:20.958331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d95e94-5d83-46d8-8f6b-ea67cc5918a2 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:20.958331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d95e94-5d83-46d8-8f6b-ea67cc5918a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:21.030736 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-e3d95e94-5d83-46d8-8f6b-ea67cc5918a2 None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:39:21.031965 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-e3d95e94-5d83-46d8-8f6b-ea67cc5918a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:21.039394 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1472/2939] 10.222.0.60 () {58 vars in 1061 bytes} [Thu May 26 13:39:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:39:21.045892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae236df-6ae9-404b-87af-da88b679dd35 service cinder] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:21.058465 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae236df-6ae9-404b-87af-da88b679dd35 service cinder] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:21.062806 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:21.063490 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:21.063766 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:21.064042 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:21.065865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:21.164865 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:21.166310 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:21.186408 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1468/2940] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:39:24.808511 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d95e94-5d83-46d8-8f6b-ea67cc5918a2 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:24.821466 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d95e94-5d83-46d8-8f6b-ea67cc5918a2 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:24.826602 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:24.827498 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:24.827878 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:24.828152 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:24.829914 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:24.843106 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:24.844718 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:24.856585 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1473/2941] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:39:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:39:28.317633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:28.327885 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7359e90-f6c9-45b4-b56a-1e51149e74c5 service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:28.332961 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:28.333843 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:28.334313 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:28.334809 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:28.337784 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:28.350158 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:28.351869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:28.365251 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1469/2942] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:39:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:39:28.451110 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:28.452567 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:28.467070 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01590b-f250-4f8e-bd36-42a8aa4075a7 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:28.471748 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:28.472621 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:28.472898 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:28.473168 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] PATH_INFO: `/v3/users/491ef95e936943d5a144876c2fe22eaf` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:28.474336 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491ef95e936943d5a144876c2fe22eaf)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:28.476349 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:28.618666 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491ef95e936943d5a144876c2fe22eaf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:28.619238 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491ef95e936943d5a144876c2fe22eaf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:28.626776 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491ef95e936943d5a144876c2fe22eaf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:28.641758 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491ef95e936943d5a144876c2fe22eaf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:28.642572 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491ef95e936943d5a144876c2fe22eaf'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:28.710196 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1474/2943] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:39:28 2022] DELETE /identity/v3/users/491ef95e936943d5a144876c2fe22eaf => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:28.973962 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:28.985670 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c960ee-2dbb-408a-bc6c-81e005694196 service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:29.048889 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:29.049762 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.050038 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.050309 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] PATH_INFO: `/v3/projects/2bbaabf20652434cb79e0652ec678fbb` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.051512 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbaabf20652434cb79e0652ec678fbb)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:29.053401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:29.175416 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbaabf20652434cb79e0652ec678fbb', 'request_id': 'req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.182104 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbaabf20652434cb79e0652ec678fbb', 'request_id': 'req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.183340 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:29.188133 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbaabf20652434cb79e0652ec678fbb', 'request_id': 'req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.278478 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] The token cache is being invalidate because project 2bbaabf20652434cb79e0652ec678fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:39:29.278723 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.279401 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.280955 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1470/2944] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:39:28 2022] DELETE /identity/v3/projects/2bbaabf20652434cb79e0652ec678fbb => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:29.284978 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:29.286398 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:29.300321 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba721065-2220-4692-9879-fdcd7760f744 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:29.357308 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:29.358189 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:29.358465 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:29.358766 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] PATH_INFO: `/v3/users/34ce93a717b748febc7be09a6c3f4f90` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:29.371906 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ce93a717b748febc7be09a6c3f4f90)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:29.373809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:29.385286 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:29.587125 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ce93a717b748febc7be09a6c3f4f90'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.587931 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ce93a717b748febc7be09a6c3f4f90'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.594380 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ce93a717b748febc7be09a6c3f4f90'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.606538 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ce93a717b748febc7be09a6c3f4f90'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.607198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ce93a717b748febc7be09a6c3f4f90'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:29.703969 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1475/2945] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:39:29 2022] DELETE /identity/v3/users/34ce93a717b748febc7be09a6c3f4f90 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:29.941585 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:39:29.943114 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:39:29.957633 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ded5ef-10e3-4a24-a29a-abbb3d0f26f0 admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:39:30.017021 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:39:30.017892 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:39:30.018169 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:39:30.018439 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] PATH_INFO: `/v3/projects/119bcfc13c6746198f8d39a93af55731` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:39:30.029402 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=119bcfc13c6746198f8d39a93af55731)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:39:30.031496 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:39:30.130016 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '119bcfc13c6746198f8d39a93af55731', 'request_id': 'req-5a411e6f-f250-4500-beba-55bd80a82f98'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:30.137188 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '119bcfc13c6746198f8d39a93af55731', 'request_id': 'req-5a411e6f-f250-4500-beba-55bd80a82f98'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:30.143228 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '119bcfc13c6746198f8d39a93af55731', 'request_id': 'req-5a411e6f-f250-4500-beba-55bd80a82f98'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:30.208291 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] The token cache is being invalidate because project 119bcfc13c6746198f8d39a93af55731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80388) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:39:30.208487 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:30.209100 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-5a411e6f-f250-4500-beba-55bd80a82f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:39:30.210647 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1471/2946] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:39:29 2022] DELETE /identity/v3/projects/119bcfc13c6746198f8d39a93af55731 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:39:39.726967 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=22,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:39:40.205154 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:DELETE=10,keystone:SELECT=59,keystone:INSERT=2 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:21.736743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:21.738175 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:21.818095 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b8f4d-832f-47d1-ad70-9bb51e33eca7 admin admin] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:21.865638 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e8b7a-c32d-411c-afe2-1219a6891603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17335764c3fd4960ab969211ca353b75', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:21.866280 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e8b7a-c32d-411c-afe2-1219a6891603 service cinder] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:21.866663 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e8b7a-c32d-411c-afe2-1219a6891603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:21.873191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e8b7a-c32d-411c-afe2-1219a6891603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:21.873191 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-db7e8b7a-c32d-411c-afe2-1219a6891603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:21.953054 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e8b7a-c32d-411c-afe2-1219a6891603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:21.954809 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e8b7a-c32d-411c-afe2-1219a6891603 service cinder] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:21.973880 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1476/2947] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:40:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:40:27.146494 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cccc6e-8ea3-46a6-a4ae-d7e2a6055e0e None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.147046 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cccc6e-8ea3-46a6-a4ae-d7e2a6055e0e None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.147148 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cccc6e-8ea3-46a6-a4ae-d7e2a6055e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.175069 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-27cccc6e-8ea3-46a6-a4ae-d7e2a6055e0e None None] MFA Rules not processed for user `d9fc5cfd0a50441c9fd9116a7b5c514a`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:27.176285 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-27cccc6e-8ea3-46a6-a4ae-d7e2a6055e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:27.184184 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1472/2948] 10.222.0.60 () {58 vars in 957 bytes} [Thu May 26 13:40:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:40:27.223654 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf018d-12e8-48ba-8b42-14b8170b0911 None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.224385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf018d-12e8-48ba-8b42-14b8170b0911 None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.224385 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebf018d-12e8-48ba-8b42-14b8170b0911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.258927 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=100 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:27.278786 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-5ebf018d-12e8-48ba-8b42-14b8170b0911 None None] MFA Rules not processed for user `175b409f5ee842ddb9f5f3468a6a461b`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:27.280112 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5ebf018d-12e8-48ba-8b42-14b8170b0911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:27.345170 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1477/2949] 10.222.0.60 () {58 vars in 1059 bytes} [Thu May 26 13:40:27 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:40:27.351476 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cccc6e-8ea3-46a6-a4ae-d7e2a6055e0e None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.362777 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cccc6e-8ea3-46a6-a4ae-d7e2a6055e0e None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.366369 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185dcaa-bdef-493c-8029-83879bda518a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '175b409f5ee842ddb9f5f3468a6a461b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.367089 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185dcaa-bdef-493c-8029-83879bda518a service glance] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.367371 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185dcaa-bdef-493c-8029-83879bda518a service glance] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.367649 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185dcaa-bdef-493c-8029-83879bda518a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.369452 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-2185dcaa-bdef-493c-8029-83879bda518a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:27.466381 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185dcaa-bdef-493c-8029-83879bda518a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.469905 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185dcaa-bdef-493c-8029-83879bda518a service glance] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.492869 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1473/2950] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:40:27.703553 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf018d-12e8-48ba-8b42-14b8170b0911 None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:27.704964 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-5ebf018d-12e8-48ba-8b42-14b8170b0911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:27.763026 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebf018d-12e8-48ba-8b42-14b8170b0911 None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:27.767713 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d68f-ad0e-46f0-aeb0-516259100b45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:27.768370 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d68f-ad0e-46f0-aeb0-516259100b45 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:27.776040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d68f-ad0e-46f0-aeb0-516259100b45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:27.776040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d68f-ad0e-46f0-aeb0-516259100b45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:27.776040 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-9a02d68f-ad0e-46f0-aeb0-516259100b45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:27.781021 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02d68f-ad0e-46f0-aeb0-516259100b45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:27.782619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02d68f-ad0e-46f0-aeb0-516259100b45 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:27.791141 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1478/2951] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:40:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:40:28.267354 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b8250-a26b-493f-8e14-4e7f5efbf397 None None] REQUEST_METHOD: `POST` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.268248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b8250-a26b-493f-8e14-4e7f5efbf397 None None] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.268248 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b8250-a26b-493f-8e14-4e7f5efbf397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.293784 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800dcd-b7b4-44bf-9918-4c62e6a7af2c None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.294329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800dcd-b7b4-44bf-9918-4c62e6a7af2c None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.294329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b800dcd-b7b4-44bf-9918-4c62e6a7af2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.319697 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-6b800dcd-b7b4-44bf-9918-4c62e6a7af2c None None] MFA Rules not processed for user `ab54d18d265a42ce9e341e59c57d4625`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:28.320254 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.auth.core [None req-c06b8250-a26b-493f-8e14-4e7f5efbf397 None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80388) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:40:28.320957 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-6b800dcd-b7b4-44bf-9918-4c62e6a7af2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:28.321681 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-c06b8250-a26b-493f-8e14-4e7f5efbf397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:28.330047 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1479/2952] 10.222.0.60 () {58 vars in 1061 bytes} [Thu May 26 13:40:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 13:40:28.336372 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b800dcd-b7b4-44bf-9918-4c62e6a7af2c None None] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:28.346316 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b800dcd-b7b4-44bf-9918-4c62e6a7af2c None None] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:28.352198 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:28.353024 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.353151 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.353409 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.355326 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:28.375471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:28.375471 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:28.385284 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1480/2953] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:40:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:40:28.398581 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1474/2954] 10.222.0.60 () {58 vars in 1018 bytes} [Thu May 26 13:40:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:40:28.409700 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:28.414943 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:28.426118 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dba343-decc-4411-a0e3-fa572759fde0 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:28.432082 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:28.432823 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:28.433107 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:28.433378 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:28.444034 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:28.445576 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:28.455675 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1481/2955] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:40:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:40:31.501417 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b8250-a26b-493f-8e14-4e7f5efbf397 None None] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:31.510622 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b8250-a26b-493f-8e14-4e7f5efbf397 None None] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:31.514093 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:31.515526 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:31.515786 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:31.516058 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:31.517831 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:31.527528 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:31.528941 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:31.537662 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1475/2956] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:40:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:40:32.328079 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:32.331910 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:32.351855 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689bf94d-ff60-4936-b2ed-93f83e837ae5 service placement] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:32.357852 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:32.359041 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:32.359369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:32.359664 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:32.361548 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:32.374820 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:32.376432 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:32.387862 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1482/2957] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:40:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:40:39.461414 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:40:39.463002 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:39.481067 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb82c1-0543-4f8a-ab1c-070668ae35dc service neutron] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:40:39.488071 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5643e9f777c94d06a2f5c687dd8919b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:40:39.488753 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:40:39.489030 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:40:39.489302 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:40:39.491335 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:40:39.506511 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:40:39.508135 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:40:39.521988 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1476/2958] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:40:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:40:42.383142 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=75 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:40:49.514706 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=99 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:45.169611 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:45.193619 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ee21a-a39c-4640-bdad-63e46d3de57d service nova] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:45.197741 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab54d18d265a42ce9e341e59c57d4625', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:45.198635 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:45.198970 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:45.199248 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:45.202331 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:45.267743 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:45.269174 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:45.279207 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1483/2959] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 13:41:45.930772 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:45.932804 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:41:45.947456 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ad99f-3c5e-4190-b0d1-0dc1ff06aa05 service nova] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:45.956195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:45.956195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:45.956195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:45.956195 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] PATH_INFO: `/v3/users/d9fc5cfd0a50441c9fd9116a7b5c514a` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:45.956577 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9fc5cfd0a50441c9fd9116a7b5c514a)` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:45.958128 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:46.159814 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9fc5cfd0a50441c9fd9116a7b5c514a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.160474 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9fc5cfd0a50441c9fd9116a7b5c514a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.161076 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9fc5cfd0a50441c9fd9116a7b5c514a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.174359 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9fc5cfd0a50441c9fd9116a7b5c514a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.181372 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.notifications [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9fc5cfd0a50441c9fd9116a7b5c514a'} {{(pid=80388) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.248533 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1477/2960] 10.222.0.60 () {58 vars in 1223 bytes} [Thu May 26 13:41:45 2022] DELETE /identity/v3/users/d9fc5cfd0a50441c9fd9116a7b5c514a => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:41:46.537404 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] Authenticating user token {{(pid=80389) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:41:46.548945 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d6b29-06df-40b9-a174-43c138f1c8a0 service neutron] Validating token access rules against request {{(pid=80389) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:41:46.628892 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bc7504a99e7249a395b2c1252117a52e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd4d4adba733e41f4aa7039514b116efa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80389) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:41:46.629770 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:41:46.630053 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:41:46.630329 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] PATH_INFO: `/v3/projects/9b22744f23304e41b1c3a5d2bc0afdb9` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:41:46.631540 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b22744f23304e41b1c3a5d2bc0afdb9)` {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:41:46.633571 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] RBAC: Authorization granted {{(pid=80389) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:41:46.751869 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b22744f23304e41b1c3a5d2bc0afdb9', 'request_id': 'req-16df7d63-1a7c-4454-8b33-32e2571d4fb5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.758427 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b22744f23304e41b1c3a5d2bc0afdb9', 'request_id': 'req-16df7d63-1a7c-4454-8b33-32e2571d4fb5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.832369 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b22744f23304e41b1c3a5d2bc0afdb9', 'request_id': 'req-16df7d63-1a7c-4454-8b33-32e2571d4fb5'} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.845057 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] The token cache is being invalidate because project 9b22744f23304e41b1c3a5d2bc0afdb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80389) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 13:41:46.845345 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.846005 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.notifications [None req-16df7d63-1a7c-4454-8b33-32e2571d4fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80389) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 13:41:46.847684 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1484/2961] 10.222.0.60 () {58 vars in 1232 bytes} [Thu May 26 13:41:46 2022] DELETE /identity/v3/projects/9b22744f23304e41b1c3a5d2bc0afdb9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 13:41:56.244631 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:41:56.841543 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:42:08.915090 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:42:08.916508 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:42:09.027659 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981b47f4-f63e-493a-8923-e90da74d1afe admin admin] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:42:09.088750 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:42:09.089407 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:42:09.089691 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:42:09.089968 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:42:09.091918 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:42:09.103575 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:42:09.105141 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:42:09.115910 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1478/2962] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:42:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:42:19.111421 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=75 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:11.974705 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42709-700a-40f4-aa49-c6544cfef8ef None None] REQUEST_METHOD: `POST` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:11.975312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42709-700a-40f4-aa49-c6544cfef8ef None None] SCRIPT_NAME: `/identity` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:11.975312 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be42709-700a-40f4-aa49-c6544cfef8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80389) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:12.130035 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.auth.core [None req-8be42709-700a-40f4-aa49-c6544cfef8ef None None] MFA Rules not processed for user `15d6aefae65c4c54b16d22c6f652dcbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80389) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 13:44:12.131316 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG keystone.common.fernet_utils [None req-8be42709-700a-40f4-aa49-c6544cfef8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80389) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:12.162344 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: [pid: 80389|app: 0|req: 1485/2963] 10.222.0.15 () {58 vars in 1015 bytes} [Thu May 26 13:44:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 13:44:12.177351 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] Authenticating user token {{(pid=80388) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 13:44:12.178789 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.fernet_utils [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80388) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 13:44:12.213008 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca84d0a-f1df-4714-ae3e-c8360e49c0ad service placement] Validating token access rules against request {{(pid=80388) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 13:44:12.219365 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70532bbd-1723-4437-bf25-8d4588ea4b60 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '15d6aefae65c4c54b16d22c6f652dcbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5dd2a2460594ca5b136d9ca5e5eabbc', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80388) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 13:44:12.220068 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532bbd-1723-4437-bf25-8d4588ea4b60 service placement] REQUEST_METHOD: `GET` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 13:44:12.220450 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532bbd-1723-4437-bf25-8d4588ea4b60 service placement] SCRIPT_NAME: `/identity` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 13:44:12.220752 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532bbd-1723-4437-bf25-8d4588ea4b60 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80388) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 13:44:12.231970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70532bbd-1723-4437-bf25-8d4588ea4b60 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 13:44:12.231970 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70532bbd-1723-4437-bf25-8d4588ea4b60 service placement] RBAC: Authorization granted {{(pid=80388) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 13:44:12.242636 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: [pid: 80388|app: 0|req: 1479/2964] 10.222.0.60 () {60 vars in 1365 bytes} [Thu May 26 13:44:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 13:44:22.155792 dv-cinder-815146-11-iscsi devstack@keystone.service[80389]: DEBUG dbcounter [-] [80389] Writing DB stats keystone:SELECT=12 {{(pid=80389) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 13:44:22.238066 dv-cinder-815146-11-iscsi devstack@keystone.service[80388]: DEBUG dbcounter [-] [80388] Writing DB stats keystone:SELECT=15 {{(pid=80388) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}